Sep 09 09:41:00.334869 ip-10-0-143-228 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 09:41:00.334881 ip-10-0-143-228 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 09:41:00.334888 ip-10-0-143-228 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 09:41:00.335098 ip-10-0-143-228 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 09:41:10.388424 ip-10-0-143-228 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 09:41:10.388439 ip-10-0-143-228 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ecd5e6b0ce51459b9104aff722fc47dd -- Sep 09 09:42:57.382345 ip-10-0-143-228 systemd[1]: Starting Kubernetes Kubelet... Sep 09 09:42:57.796159 ip-10-0-143-228 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 09:42:57.796159 ip-10-0-143-228 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 09:42:57.796159 ip-10-0-143-228 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 09:42:57.796159 ip-10-0-143-228 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 09:42:57.796159 ip-10-0-143-228 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 09:42:57.797212 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.797111 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 09:42:57.803833 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803818 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:57.803833 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803834 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803839 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803843 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803846 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803850 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803853 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803857 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803861 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803864 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803867 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803870 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803873 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803876 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803879 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803881 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803885 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803887 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803890 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803892 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803895 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:57.803896 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803898 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803901 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803903 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803906 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803909 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803917 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803920 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803922 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803925 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803927 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803930 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803932 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803935 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803937 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803940 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803944 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803948 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803951 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803954 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:57.804399 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803957 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803959 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803962 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803964 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803966 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803969 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803971 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803974 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803976 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803979 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803981 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803983 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803986 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803989 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803991 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803995 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.803997 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804000 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804002 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804005 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:57.804859 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804007 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804010 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804013 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804015 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804018 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804020 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804023 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804025 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804028 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804030 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804033 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804036 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804038 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804040 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804043 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804046 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804048 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804052 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804054 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804057 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:57.805395 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804059 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804061 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804064 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804066 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804069 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804071 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804075 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804081 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804084 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804087 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804090 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804093 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804108 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804111 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804113 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804116 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804118 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804121 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804123 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804782 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:57.805892 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804788 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804791 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804793 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804796 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804799 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804801 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804804 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804806 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804809 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804813 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804818 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804820 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804823 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804825 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804828 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804830 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804833 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804836 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804838 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804842 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:57.806397 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804844 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804848 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804851 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804855 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804858 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804862 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804865 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804868 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804871 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804873 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804876 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804879 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804881 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804883 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804886 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804888 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804891 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804893 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804896 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:57.806905 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804898 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804901 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804904 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804906 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804912 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804914 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804917 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804919 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804922 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804924 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804927 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804929 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804932 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804935 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804937 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804940 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804942 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804945 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804947 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804950 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:57.807373 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804952 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804954 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804957 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804960 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804962 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804965 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804967 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804970 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804973 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804975 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804978 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804980 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804984 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804986 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804989 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804991 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804994 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.804997 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805000 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805003 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:57.807858 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805005 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805008 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805011 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805013 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805016 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805018 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805021 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805023 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805025 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805028 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805030 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805033 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805035 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805038 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805040 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805043 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805045 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805048 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805051 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805431 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:57.808355 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805437 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805441 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805444 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805448 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805450 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805454 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805456 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805459 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805462 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805465 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805468 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805471 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805476 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805478 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805481 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805483 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805487 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805491 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805493 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805496 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:57.808844 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805499 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805501 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805503 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805506 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805508 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805511 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805514 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805516 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805519 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805521 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805523 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805526 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805529 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805531 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805534 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805536 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805538 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805541 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805543 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805546 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:57.809341 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805549 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805551 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805555 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805557 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805561 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805564 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805566 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805569 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805571 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805574 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805577 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805579 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805582 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805584 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805587 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805589 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805592 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805594 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805597 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805599 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:57.809822 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805602 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805604 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805607 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805610 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805612 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805615 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805617 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805620 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805623 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805626 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805629 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805631 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805634 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805636 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805639 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805641 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805645 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805648 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805651 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805654 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:57.810368 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805656 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805659 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805661 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805664 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805666 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805669 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805671 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805673 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805676 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805679 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805681 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805684 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805688 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805691 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805694 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805697 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805700 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.805702 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805771 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805807 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 09:42:57.810900 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805813 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805817 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805822 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805825 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805829 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805833 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805836 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805839 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805850 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805853 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805856 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805859 2578 flags.go:64] FLAG: --cgroup-root="" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805862 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805865 2578 flags.go:64] FLAG: --client-ca-file="" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805868 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805871 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805874 2578 flags.go:64] FLAG: --cluster-domain="" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805877 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805880 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805883 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805886 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805890 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805893 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 09:42:57.811417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805896 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805899 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805902 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805907 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805910 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805913 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805915 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805919 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805922 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805925 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805928 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805931 2578 flags.go:64] FLAG: --enable-server="true" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805933 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805938 2578 flags.go:64] FLAG: --event-burst="100" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805941 2578 flags.go:64] FLAG: --event-qps="50" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805943 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805946 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805950 2578 flags.go:64] FLAG: --eviction-hard="" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805954 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805957 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805960 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805963 2578 flags.go:64] FLAG: --eviction-soft="" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805965 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805968 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805971 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 09:42:57.811957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805974 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805977 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805979 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805982 2578 flags.go:64] FLAG: --feature-gates="" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805986 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805989 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805992 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805995 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.805998 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806001 2578 flags.go:64] FLAG: --help="false" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806005 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-143-228.ec2.internal" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806008 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806010 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806013 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806017 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806020 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806022 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806025 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806028 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806030 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806033 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806036 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806039 2578 flags.go:64] FLAG: --kube-reserved="" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806042 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 09:42:57.812598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806046 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806049 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806052 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806055 2578 flags.go:64] FLAG: --lock-file="" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806057 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806060 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806063 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806068 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806071 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806073 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806076 2578 flags.go:64] FLAG: --logging-format="text" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806079 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806082 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806085 2578 flags.go:64] FLAG: --manifest-url="" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806088 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806092 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806109 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806113 2578 flags.go:64] FLAG: --max-pods="110" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806117 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806121 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806123 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806126 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806129 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806132 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806135 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 09:42:57.813227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806141 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806144 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806147 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806150 2578 flags.go:64] FLAG: --pod-cidr="" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806153 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806158 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806161 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806164 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806168 2578 flags.go:64] FLAG: --port="10250" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806171 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806174 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cae21f644db4c88e" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806177 2578 flags.go:64] FLAG: --qos-reserved="" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806180 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806183 2578 flags.go:64] FLAG: --register-node="true" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806186 2578 flags.go:64] FLAG: --register-with-taints="" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806189 2578 flags.go:64] FLAG: --registry-burst="10" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806192 2578 flags.go:64] FLAG: --registry-qps="5" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806194 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806197 2578 flags.go:64] FLAG: --reserved-memory="" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806200 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806203 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806206 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806209 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806212 2578 flags.go:64] FLAG: --runonce="false" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806214 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 09:42:57.813883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806222 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806225 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806229 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806231 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806235 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806237 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806240 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806243 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806246 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806249 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806251 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806254 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806257 2578 flags.go:64] FLAG: --system-cgroups="" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806260 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806265 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806269 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806272 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806275 2578 flags.go:64] FLAG: --tls-min-version="" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806278 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806282 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806284 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806287 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806290 2578 flags.go:64] FLAG: --v="2" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806294 2578 flags.go:64] FLAG: --version="false" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806297 2578 flags.go:64] FLAG: --vmodule="" Sep 09 09:42:57.814513 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806301 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806304 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806422 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806426 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806430 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806433 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806438 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806443 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806446 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806449 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806452 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806455 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806457 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806460 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806463 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806465 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806468 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806471 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:57.815204 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806474 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806477 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806481 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806483 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806487 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806490 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806492 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806495 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806498 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806501 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806503 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806505 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806508 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806510 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806513 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806515 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806518 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806520 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806523 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:57.815638 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806525 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806528 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806531 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806534 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806536 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806538 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806541 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806544 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806546 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806548 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806551 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806553 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806556 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806559 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806561 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806563 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806566 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806569 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806572 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806574 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806576 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:57.816117 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806579 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806582 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806584 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806587 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806599 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806602 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806604 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806607 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806609 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806612 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806614 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806617 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806619 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806624 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806626 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806629 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806631 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806634 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806636 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806639 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:57.816627 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806641 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806645 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806648 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806651 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806654 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806657 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806659 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806662 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806665 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806667 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806670 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806672 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806675 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806677 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806680 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806683 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806685 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806688 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806690 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806692 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:57.817142 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806695 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806698 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.806700 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.806705 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.814561 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.814575 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.815545 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.815553 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815615 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815620 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815623 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815626 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815630 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815633 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815635 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:57.817659 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815638 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815641 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815644 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815647 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815650 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815653 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815655 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815658 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815660 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815663 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815665 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815674 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815677 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815679 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815682 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815685 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815687 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815690 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815693 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815695 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:57.818042 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815698 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815700 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815703 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815706 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815708 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815711 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815714 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815716 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815719 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815721 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815724 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815726 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815729 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815731 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815734 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815736 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815741 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815744 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815747 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:57.818547 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815750 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815752 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815755 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815758 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815767 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815775 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815778 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815781 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815784 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815786 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815789 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815791 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815794 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815796 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815799 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815801 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815804 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815806 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815809 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:57.819014 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815811 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815814 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815816 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815819 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815821 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815824 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815826 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815829 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815831 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815834 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815836 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815839 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815841 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815843 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815846 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815848 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815851 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815853 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815855 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815863 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:57.819611 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815868 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815871 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815879 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815882 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815885 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815887 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815891 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815893 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815896 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815899 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815903 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815906 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815909 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.815912 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.815917 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 09:42:57.820110 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816056 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816061 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816064 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816067 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816069 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816072 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816075 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816077 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816080 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816083 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816086 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816089 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816092 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816111 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816115 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816117 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816120 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816129 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816132 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816134 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:57.820481 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816137 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816139 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816142 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816144 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816148 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816152 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816154 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816158 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816161 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816165 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816168 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816171 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816174 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816177 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816179 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816182 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816184 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816187 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816189 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:57.820952 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816192 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816194 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816197 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816199 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816201 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816204 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816206 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816209 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816211 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816214 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816216 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816225 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816227 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816230 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816232 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816235 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816237 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816240 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816242 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816245 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:57.821429 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816247 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816250 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816253 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816255 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816258 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816260 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816262 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816265 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816268 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816270 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816272 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816275 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816277 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816280 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816283 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816286 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816289 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816292 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816295 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816297 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:57.821914 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816300 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816303 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816305 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816308 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816317 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816319 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816322 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816324 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816327 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816329 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816332 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816334 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816336 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816339 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816341 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816344 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816346 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816349 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816351 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:57.822413 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:57.816354 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:57.822912 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.816358 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 09:42:57.822912 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.816451 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 09:42:57.822912 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.819008 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 09:42:57.822912 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.820132 2578 server.go:1019] "Starting client certificate rotation" Sep 09 09:42:57.822912 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.820245 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 09:42:57.822912 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.820279 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 09:42:57.823062 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.823045 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 09:42:57.828983 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.828951 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 09:42:57.842459 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.842364 2578 log.go:25] "Validated CRI v1 runtime API" Sep 09 09:42:57.845899 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.845882 2578 log.go:25] "Validated CRI v1 image API" Sep 09 09:42:57.846739 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.846724 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 09:42:57.851177 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.851151 2578 fs.go:135] Filesystem UUIDs: map[0ac678cb-9ddc-4ef0-877a-8ca8c387805d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 eeec3981-0339-4685-90bb-f0784beffb18:/dev/nvme0n1p4] Sep 09 09:42:57.851251 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.851176 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 09:42:57.853634 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.853612 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 09:42:57.856379 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.856272 2578 manager.go:216] Machine: {Timestamp:2026-09-09 09:42:57.854816975 +0000 UTC m=+0.372428263 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096798 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24347f7a1d1a217655cb5d14e43a80 SystemUUID:ec24347f-7a1d-1a21-7655-cb5d14e43a80 BootID:ecd5e6b0-ce51-459b-9104-aff722fc47dd Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a0:f1:67:f7:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a0:f1:67:f7:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:1f:ef:f0:75:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 09:42:57.856379 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.856369 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 09:42:57.856520 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.856462 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 09:42:57.860126 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.860089 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 09:42:57.860248 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.860129 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 09:42:57.860996 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.860986 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 09:42:57.861029 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.861000 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 09:42:57.861029 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.861007 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 09:42:57.861083 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.861035 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 09:42:57.862337 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.862327 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 09:42:57.867036 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867025 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 09 09:42:57.867161 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867151 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 09:42:57.867199 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867180 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 09 09:42:57.867199 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867189 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 09:42:57.867277 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867203 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 09:42:57.867277 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867212 2578 kubelet.go:398] "Adding apiserver pod source" Sep 09 09:42:57.867277 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867224 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 09:42:57.867581 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867569 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 09:42:57.867621 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.867594 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 09:42:57.869850 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.869834 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 09:42:57.872748 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.872734 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 09:42:57.872826 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.872763 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 09:42:57.874082 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874071 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 09:42:57.874156 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874087 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 09:42:57.874156 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874093 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 09:42:57.874156 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874115 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 09:42:57.874156 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874126 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 09:42:57.874156 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874133 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 09:42:57.874156 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874147 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 09:42:57.874156 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874152 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 09:42:57.874156 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874157 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 09:42:57.874409 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874162 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 09:42:57.874409 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874176 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 09:42:57.874409 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.874181 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 09:42:57.875292 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.875247 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 09:42:57.875639 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.875615 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hjl4d" Sep 09 09:42:57.876465 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.876450 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 09:42:57.877737 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.877712 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 09:42:57.877737 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.877717 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 09:42:57.881267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.881251 2578 server.go:1268] "Started kubelet" Sep 09 09:42:57.881364 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.881320 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 09:42:57.881439 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.881390 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 09:42:57.881492 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.881462 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 09:42:57.882177 ip-10-0-143-228 systemd[1]: Started Kubernetes Kubelet. Sep 09 09:42:57.882902 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.882347 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hjl4d" Sep 09 09:42:57.882902 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.882645 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 09 09:42:57.883060 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.882963 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 09:42:57.885478 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.885460 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 09:42:57.887913 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.887897 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 09:42:57.889092 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.887946 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-228.ec2.internal.18d39dcc529e5e4a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-228.ec2.internal,UID:ip-10-0-143-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-228.ec2.internal,},FirstTimestamp:2026-09-09 09:42:57.881218634 +0000 UTC m=+0.398829907,LastTimestamp:2026-09-09 09:42:57.881218634 +0000 UTC m=+0.398829907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-228.ec2.internal,}" Sep 09 09:42:57.890252 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.890241 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 09:42:57.890314 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.890257 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 09:42:57.890367 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.890354 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:57.891048 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891024 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 09:42:57.891048 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891049 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 09:42:57.891201 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891033 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 09:42:57.891201 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891157 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 09 09:42:57.891201 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891165 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 09 09:42:57.891321 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891290 2578 factory.go:55] Registering systemd factory Sep 09 09:42:57.891321 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891304 2578 factory.go:223] Registration of the systemd container factory successfully Sep 09 09:42:57.891526 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891513 2578 factory.go:153] Registering CRI-O factory Sep 09 09:42:57.891526 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891527 2578 factory.go:223] Registration of the crio container factory successfully Sep 09 09:42:57.891618 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891567 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 09:42:57.891618 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891589 2578 factory.go:103] Registering Raw factory Sep 09 09:42:57.891618 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.891611 2578 manager.go:1196] Started watching for new ooms in manager Sep 09 09:42:57.892083 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.892071 2578 manager.go:349] Starting recovery of all containers Sep 09 09:42:57.894812 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.894779 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:57.902028 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.901946 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal" Sep 09 09:42:57.905635 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.905614 2578 manager.go:354] Recovery completed Sep 09 09:42:57.910878 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.910865 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:57.912378 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.912363 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:57.912445 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.912389 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:57.912445 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.912399 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:57.912880 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.912863 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 09:42:57.912880 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.912880 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 09:42:57.912964 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.912895 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 09 09:42:57.912996 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.912871 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:57.913624 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.913610 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:57.913709 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.913639 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:57.913709 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.913654 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:57.915026 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.915014 2578 policy_none.go:49] "None policy: Start" Sep 09 09:42:57.915082 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.915030 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 09:42:57.915082 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.915039 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 09:42:57.917043 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.917032 2578 policy_none.go:47] "Start" Sep 09 09:42:57.950644 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.950629 2578 manager.go:337] "Starting Device Plugin manager" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.950669 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.950682 2578 server.go:87] "Starting device plugin registration server" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.950904 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.950914 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.951018 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.951085 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.951093 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.951539 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 09:42:57.971914 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.951576 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:57.983420 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.983393 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 09:42:57.984606 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.984591 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 09:42:57.984677 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.984643 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 09:42:57.984677 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.984666 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 09:42:57.984786 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:57.984708 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 09:42:57.986984 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:57.986962 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:58.051306 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.051261 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:58.051998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.051983 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:58.052060 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.052010 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:58.052060 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.052021 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:58.052060 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.052042 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.061672 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.061660 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.061710 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.061678 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-228.ec2.internal\": node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.071948 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.071928 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.085220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.085192 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"] Sep 09 09:42:58.085283 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.085254 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:58.086473 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.086458 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:58.086541 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.086486 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:58.086541 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.086500 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:58.088806 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.088794 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:58.088933 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.088920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.088968 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.088949 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:58.089467 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.089452 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:58.089534 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.089484 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:58.089534 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.089495 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:58.089594 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.089452 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:58.089594 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.089555 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:58.089594 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.089568 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:58.091756 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.091743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.091812 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.091765 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:58.092194 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.092176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.092288 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.092202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/728b04a33548859b274bbec2cc5b3fee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"728b04a33548859b274bbec2cc5b3fee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.092288 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.092219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.092437 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.092425 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:58.092473 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.092456 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:58.092473 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.092468 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:58.136668 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.136645 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.140802 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.140786 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.172209 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.172190 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.192486 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.192463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/728b04a33548859b274bbec2cc5b3fee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"728b04a33548859b274bbec2cc5b3fee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.192534 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.192492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.192534 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.192508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.192534 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.192531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.192626 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.192563 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/728b04a33548859b274bbec2cc5b3fee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"728b04a33548859b274bbec2cc5b3fee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.192626 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.192570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.272458 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.272426 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.373187 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.373124 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.439575 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.439559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.444399 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.444211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 09:42:58.474056 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.474036 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.574522 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.574502 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.675058 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.675010 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.775485 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.775461 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.819998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.819974 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 09:42:58.820437 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.820176 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 09:42:58.820437 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.820177 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 09:42:58.876384 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.876359 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:58.890122 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.890068 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 09:37:59 +0000 UTC" deadline="2028-06-16 05:44:11.228785792 +0000 UTC" Sep 09 09:42:58.890122 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:58.890115 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15500h1m12.338673538s" Sep 09 09:42:58.976935 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:58.976918 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:59.077560 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:59.077534 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:59.125573 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:59.125546 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728b04a33548859b274bbec2cc5b3fee.slice/crio-6d35dd561938edf393e9ca40f9f91ec2d2954f2540841da800ad8d6cb8f607e8 WatchSource:0}: Error finding container 6d35dd561938edf393e9ca40f9f91ec2d2954f2540841da800ad8d6cb8f607e8: Status 404 returned error can't find the container with id 6d35dd561938edf393e9ca40f9f91ec2d2954f2540841da800ad8d6cb8f607e8 Sep 09 09:42:59.125782 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:42:59.125764 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4729ed97ef7a8c38fc61d9b5517096f.slice/crio-3e139da2fc05cc9cb5c0a5b078436a5986ce7a4a3417645f93b183d1e2ffe300 WatchSource:0}: Error finding container 3e139da2fc05cc9cb5c0a5b078436a5986ce7a4a3417645f93b183d1e2ffe300: Status 404 returned error can't find the container with id 3e139da2fc05cc9cb5c0a5b078436a5986ce7a4a3417645f93b183d1e2ffe300 Sep 09 09:42:59.130034 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:59.130002 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 09:42:59.178249 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:59.178216 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:59.278707 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:42:59.278656 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 09:42:59.294734 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:59.294710 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:59.305543 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:59.304582 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:59.391068 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:59.391049 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 09:42:59.402331 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:59.402313 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 09:42:59.403160 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:59.403147 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 09:42:59.410923 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:42:59.410908 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 09:43:00.806937 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:00.806912 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:43:01.007131 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.007052 2578 apiserver.go:52] "Watching apiserver" Sep 09 09:43:01.014073 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.014048 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 09:43:01.014459 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.014434 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fqn8r","kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt","openshift-cluster-node-tuning-operator/tuned-zdmm8","openshift-dns/node-resolver-s8b84","openshift-multus/multus-additional-cni-plugins-f6sfs","openshift-network-diagnostics/network-check-target-dp8t9","openshift-network-operator/iptables-alerter-mcr6f","kube-system/konnectivity-agent-9jszf","openshift-image-registry/node-ca-vxccb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal","openshift-multus/multus-bzpqw","openshift-multus/network-metrics-daemon-g26bw","openshift-ovn-kubernetes/ovnkube-node-sbpcq"] Sep 09 09:43:01.017163 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.017135 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:01.017296 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.017227 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:01.019170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.019126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:01.019317 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.019199 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:01.021666 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.021648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.024196 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.023720 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.024196 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.023763 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 09:43:01.024196 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.024079 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 09:43:01.024389 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.024198 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 09:43:01.025127 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.025091 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d8cdb\"" Sep 09 09:43:01.025868 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.025774 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 09:43:01.026708 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.026047 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 09:43:01.026708 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.026123 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.026708 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.026319 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5qxb\"" Sep 09 09:43:01.028908 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.028317 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.028908 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.028607 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 09:43:01.029063 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.029012 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pvzc2\"" Sep 09 09:43:01.029120 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.029094 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 09:43:01.029834 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.029816 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 09:43:01.030868 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.030849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:01.031272 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.031250 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 09:43:01.031455 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.031433 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 09:43:01.031455 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.031450 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-67zfz\"" Sep 09 09:43:01.031576 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.031527 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 09:43:01.031622 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.031587 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 09:43:01.031622 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.031607 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 09:43:01.033499 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.032955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.033499 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.033019 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:01.033499 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.033443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 09:43:01.033803 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.033784 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hr74x\"" Sep 09 09:43:01.033897 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.033784 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 09:43:01.036784 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.035999 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.038254 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.038076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.038489 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.038470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 09:43:01.038889 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.038867 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 09:43:01.038889 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.038871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.039029 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.038908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-registration-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.039029 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.038946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-device-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.039029 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.038982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-sys-fs\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.039029 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysctl-conf\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxtgv\" (UniqueName: \"kubernetes.io/projected/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-kube-api-access-wxtgv\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039073 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b987r\"" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lshb8\" (UniqueName: \"kubernetes.io/projected/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-kube-api-access-lshb8\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039100 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-run\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039171 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-sys\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.039220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-tmp\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-lib-modules\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-var-lib-kubelet\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-system-cni-dir\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn42m\" (UniqueName: \"kubernetes.io/projected/1606604c-8f1c-45e7-9350-0cbcbed9c931-kube-api-access-xn42m\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039556 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.039616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-kubernetes\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.040051 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-systemd\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.040051 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039573 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 09:43:01.040051 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-host\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.040051 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41645d37-fbb5-44c9-8ba5-6b4cc17ecddc-konnectivity-ca\") pod \"konnectivity-agent-9jszf\" (UID: \"41645d37-fbb5-44c9-8ba5-6b4cc17ecddc\") " pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:01.040051 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-cnibin\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.040051 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.039983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.040643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-etc-selinux\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.040643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysctl-d\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.040643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-tuned\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.040643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-hosts-file\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.040643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-tmp-dir\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.040643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41645d37-fbb5-44c9-8ba5-6b4cc17ecddc-agent-certs\") pod \"konnectivity-agent-9jszf\" (UID: \"41645d37-fbb5-44c9-8ba5-6b4cc17ecddc\") " pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:01.040643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:01.040643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-socket-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.041026 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5jls\" (UniqueName: \"kubernetes.io/projected/115373a4-d985-4d4e-b351-c3b00021f042-kube-api-access-n5jls\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.041026 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-modprobe-d\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.041026 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw6k7\" (UniqueName: \"kubernetes.io/projected/d9f10052-2bb2-49e8-a943-46101a17508c-kube-api-access-bw6k7\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:01.041026 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.040750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysconfig\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.041229 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.041196 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 09:43:01.041437 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.041423 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wxxkq\"" Sep 09 09:43:01.041721 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.041704 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 09:43:01.041793 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.041733 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 09:43:01.041985 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.041970 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 09:43:01.042042 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.042005 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.043781 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.043540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.044027 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.043992 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 09:43:01.044423 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.044403 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 09:43:01.044509 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.044403 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7rkgd\"" Sep 09 09:43:01.044580 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.044404 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 09:43:01.045748 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.045730 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 09:43:01.045841 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.045738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m4rb8\"" Sep 09 09:43:01.061187 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.061161 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g8h25" Sep 09 09:43:01.070479 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.070461 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g8h25" Sep 09 09:43:01.129216 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.129164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"e4729ed97ef7a8c38fc61d9b5517096f","Type":"ContainerStarted","Data":"3e139da2fc05cc9cb5c0a5b078436a5986ce7a4a3417645f93b183d1e2ffe300"} Sep 09 09:43:01.130646 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.130618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" event={"ID":"728b04a33548859b274bbec2cc5b3fee","Type":"ContainerStarted","Data":"6d35dd561938edf393e9ca40f9f91ec2d2954f2540841da800ad8d6cb8f607e8"} Sep 09 09:43:01.130763 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.130738 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-run\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-sys\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-tmp\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-env-overrides\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-sys\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-var-lib-kubelet\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-systemd\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-k8s-cni-cncf-io\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-etc-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141907 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-var-lib-kubelet\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.141918 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-cnibin\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141962 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-systemd\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.142505 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.141988 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:43:01.64196435 +0000 UTC m=+3.020997486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-cnibin\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-etc-selinux\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-hosts-file\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.141805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-run\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-kubelet\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-systemd-units\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-ovnkube-config\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5jls\" (UniqueName: \"kubernetes.io/projected/115373a4-d985-4d4e-b351-c3b00021f042-kube-api-access-n5jls\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142207 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-etc-selinux\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-modprobe-d\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-hosts-file\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142264 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-run-netns\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-system-cni-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.143267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142337 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-modprobe-d\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-kubelet\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-conf-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw6k7\" (UniqueName: \"kubernetes.io/projected/d9f10052-2bb2-49e8-a943-46101a17508c-kube-api-access-bw6k7\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-registration-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-sys-fs\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-sys-fs\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142626 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-registration-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysctl-conf\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxtgv\" (UniqueName: \"kubernetes.io/projected/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-kube-api-access-wxtgv\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lshb8\" (UniqueName: \"kubernetes.io/projected/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-kube-api-access-lshb8\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysctl-conf\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-slash\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.142952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-daemon-config\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.143997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.143745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.144854 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.144140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.144854 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.144564 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.144854 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.144713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-cni-netd\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.144854 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.144769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5thb\" (UniqueName: \"kubernetes.io/projected/a66177ba-7509-4511-985b-d0c6c8734c78-kube-api-access-x5thb\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.144854 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.144813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-etc-kubernetes\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.145098 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.144881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h56mg\" (UniqueName: \"kubernetes.io/projected/6a4e5afb-d9be-4150-9620-64453bb7c048-kube-api-access-h56mg\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.145098 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.144931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-476b5\" (UniqueName: \"kubernetes.io/projected/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-kube-api-access-476b5\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.145098 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.144977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/324840fe-3788-427b-889a-c24c0050fbe7-iptables-alerter-script\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.145098 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/324840fe-3788-427b-889a-c24c0050fbe7-host-slash\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.145290 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.145290 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-lib-modules\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.145290 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-cnibin\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.145290 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-hostroot\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.145290 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-system-cni-dir\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.145290 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b3764ca-d808-4095-be9a-b4fd91464d36-kubelet-config\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.145572 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.145572 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h65q\" (UniqueName: \"kubernetes.io/projected/324840fe-3788-427b-889a-c24c0050fbe7-kube-api-access-5h65q\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.145572 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn42m\" (UniqueName: \"kubernetes.io/projected/1606604c-8f1c-45e7-9350-0cbcbed9c931-kube-api-access-xn42m\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.145572 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-kubernetes\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.145572 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-host\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.145572 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41645d37-fbb5-44c9-8ba5-6b4cc17ecddc-konnectivity-ca\") pod \"konnectivity-agent-9jszf\" (UID: \"41645d37-fbb5-44c9-8ba5-6b4cc17ecddc\") " pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:01.145869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145595 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-systemd\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.145869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-host\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.145869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1606604c-8f1c-45e7-9350-0cbcbed9c931-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.145869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-cni-bin\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.145869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.145869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysctl-d\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.145869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-tuned\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.145869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-tmp-dir\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41645d37-fbb5-44c9-8ba5-6b4cc17ecddc-agent-certs\") pod \"konnectivity-agent-9jszf\" (UID: \"41645d37-fbb5-44c9-8ba5-6b4cc17ecddc\") " pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a66177ba-7509-4511-985b-d0c6c8734c78-ovn-node-metrics-cert\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145909 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-cni-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145922 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-lib-modules\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-socket-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.145982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-var-lib-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-netns\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-serviceca\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysconfig\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b3764ca-d808-4095-be9a-b4fd91464d36-dbus\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.146233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-ovn\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146268 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-kubernetes\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-system-cni-dir\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-socket-dir-parent\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-cni-bin\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-cni-multus\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-host\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-multus-certs\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-device-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-node-log\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-log-socket\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-ovnkube-script-lib\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.146776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a4e5afb-d9be-4150-9620-64453bb7c048-cni-binary-copy\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.147170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.146826 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41645d37-fbb5-44c9-8ba5-6b4cc17ecddc-konnectivity-ca\") pod \"konnectivity-agent-9jszf\" (UID: \"41645d37-fbb5-44c9-8ba5-6b4cc17ecddc\") " pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:01.147170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.147036 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1606604c-8f1c-45e7-9350-0cbcbed9c931-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.147170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.147112 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysctl-d\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.147170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.147130 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-tmp\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.147357 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.147317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-sysconfig\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.147543 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.147521 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-device-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.147766 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.147744 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-tmp-dir\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.149862 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.149805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/115373a4-d985-4d4e-b351-c3b00021f042-socket-dir\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.149862 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.149837 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-etc-tuned\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.150261 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.150175 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41645d37-fbb5-44c9-8ba5-6b4cc17ecddc-agent-certs\") pod \"konnectivity-agent-9jszf\" (UID: \"41645d37-fbb5-44c9-8ba5-6b4cc17ecddc\") " pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:01.150349 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.150295 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:01.150349 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.150313 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:01.150349 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.150323 2578 projected.go:196] Error preparing data for projected volume kube-api-access-zw45s for pod openshift-network-diagnostics/network-check-target-dp8t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:01.150515 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.150370 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s podName:791d38b1-bef1-4dcc-b291-094e971360d4 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:01.650358775 +0000 UTC m=+3.029391925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zw45s" (UniqueName: "kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s") pod "network-check-target-dp8t9" (UID: "791d38b1-bef1-4dcc-b291-094e971360d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:01.154113 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.154088 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5jls\" (UniqueName: \"kubernetes.io/projected/115373a4-d985-4d4e-b351-c3b00021f042-kube-api-access-n5jls\") pod \"aws-ebs-csi-driver-node-25qwt\" (UID: \"115373a4-d985-4d4e-b351-c3b00021f042\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.154380 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.154354 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw6k7\" (UniqueName: \"kubernetes.io/projected/d9f10052-2bb2-49e8-a943-46101a17508c-kube-api-access-bw6k7\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:01.154730 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.154708 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn42m\" (UniqueName: \"kubernetes.io/projected/1606604c-8f1c-45e7-9350-0cbcbed9c931-kube-api-access-xn42m\") pod \"multus-additional-cni-plugins-f6sfs\" (UID: \"1606604c-8f1c-45e7-9350-0cbcbed9c931\") " pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.156133 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.156113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lshb8\" (UniqueName: \"kubernetes.io/projected/7368ba37-5e70-4a5b-b7dc-b7b825f0506a-kube-api-access-lshb8\") pod \"node-resolver-s8b84\" (UID: \"7368ba37-5e70-4a5b-b7dc-b7b825f0506a\") " pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.156469 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.156449 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxtgv\" (UniqueName: \"kubernetes.io/projected/0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb-kube-api-access-wxtgv\") pod \"tuned-zdmm8\" (UID: \"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb\") " pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.247581 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-kubelet\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247737 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-systemd-units\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247737 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-ovnkube-config\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247737 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247641 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-kubelet\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247737 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-systemd-units\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247737 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-run-netns\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-system-cni-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-kubelet\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-conf-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247803 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-run-netns\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247840 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247859 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-system-cni-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-slash\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-daemon-config\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-cni-netd\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247916 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-slash\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247877 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-kubelet\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247913 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-conf-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5thb\" (UniqueName: \"kubernetes.io/projected/a66177ba-7509-4511-985b-d0c6c8734c78-kube-api-access-x5thb\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-etc-kubernetes\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.247986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h56mg\" (UniqueName: \"kubernetes.io/projected/6a4e5afb-d9be-4150-9620-64453bb7c048-kube-api-access-h56mg\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.247998 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-476b5\" (UniqueName: \"kubernetes.io/projected/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-kube-api-access-476b5\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/324840fe-3788-427b-889a-c24c0050fbe7-iptables-alerter-script\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/324840fe-3788-427b-889a-c24c0050fbe7-host-slash\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-cnibin\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-hostroot\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b3764ca-d808-4095-be9a-b4fd91464d36-kubelet-config\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248124 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-ovnkube-config\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h65q\" (UniqueName: \"kubernetes.io/projected/324840fe-3788-427b-889a-c24c0050fbe7-kube-api-access-5h65q\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-systemd\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248183 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-etc-kubernetes\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-host\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248232 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-host\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/324840fe-3788-427b-889a-c24c0050fbe7-host-slash\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-daemon-config\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-cnibin\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248310 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-cni-netd\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248322 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-hostroot\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.248843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248353 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b3764ca-d808-4095-be9a-b4fd91464d36-kubelet-config\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248393 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-systemd\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.248461 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-cni-bin\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-cni-bin\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.248539 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret podName:9b3764ca-d808-4095-be9a-b4fd91464d36 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:01.748522907 +0000 UTC m=+3.127556052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret") pod "global-pull-secret-syncer-fqn8r" (UID: "9b3764ca-d808-4095-be9a-b4fd91464d36") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a66177ba-7509-4511-985b-d0c6c8734c78-ovn-node-metrics-cert\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-cni-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-var-lib-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248727 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-var-lib-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248755 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248803 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-cni-dir\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-netns\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248848 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-serviceca\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248887 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-netns\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b3764ca-d808-4095-be9a-b4fd91464d36-dbus\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.249732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-ovn\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-socket-dir-parent\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.248998 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b3764ca-d808-4095-be9a-b4fd91464d36-dbus\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249036 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-multus-socket-dir-parent\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249038 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-run-ovn\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-cni-bin\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-cni-multus\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-multus-certs\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249157 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-cni-bin\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-node-log\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249195 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-var-lib-cni-multus\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-log-socket\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249221 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-multus-certs\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249239 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-log-socket\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-ovnkube-script-lib\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a4e5afb-d9be-4150-9620-64453bb7c048-cni-binary-copy\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-env-overrides\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-node-log\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250361 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-serviceca\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/324840fe-3788-427b-889a-c24c0050fbe7-iptables-alerter-script\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-k8s-cni-cncf-io\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-etc-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a4e5afb-d9be-4150-9620-64453bb7c048-host-run-k8s-cni-cncf-io\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-etc-openvswitch\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249545 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66177ba-7509-4511-985b-d0c6c8734c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-env-overrides\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.249786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a66177ba-7509-4511-985b-d0c6c8734c78-ovnkube-script-lib\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.250989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.250331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a4e5afb-d9be-4150-9620-64453bb7c048-cni-binary-copy\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.251383 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.251365 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a66177ba-7509-4511-985b-d0c6c8734c78-ovn-node-metrics-cert\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.259083 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.259029 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5thb\" (UniqueName: \"kubernetes.io/projected/a66177ba-7509-4511-985b-d0c6c8734c78-kube-api-access-x5thb\") pod \"ovnkube-node-sbpcq\" (UID: \"a66177ba-7509-4511-985b-d0c6c8734c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.259788 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.259767 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h65q\" (UniqueName: \"kubernetes.io/projected/324840fe-3788-427b-889a-c24c0050fbe7-kube-api-access-5h65q\") pod \"iptables-alerter-mcr6f\" (UID: \"324840fe-3788-427b-889a-c24c0050fbe7\") " pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.260016 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.259995 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-476b5\" (UniqueName: \"kubernetes.io/projected/269a7999-e486-4a0f-bfc5-4bc9265dbbb1-kube-api-access-476b5\") pod \"node-ca-vxccb\" (UID: \"269a7999-e486-4a0f-bfc5-4bc9265dbbb1\") " pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.260095 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.260040 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h56mg\" (UniqueName: \"kubernetes.io/projected/6a4e5afb-d9be-4150-9620-64453bb7c048-kube-api-access-h56mg\") pod \"multus-bzpqw\" (UID: \"6a4e5afb-d9be-4150-9620-64453bb7c048\") " pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.336341 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.336311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" Sep 09 09:43:01.345641 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.345622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" Sep 09 09:43:01.357387 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.357368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s8b84" Sep 09 09:43:01.362012 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.361986 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" Sep 09 09:43:01.369628 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.369612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:01.376299 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.376277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:01.389056 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.388900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vxccb" Sep 09 09:43:01.397610 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.397587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mcr6f" Sep 09 09:43:01.405382 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.405358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzpqw" Sep 09 09:43:01.652349 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.652262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:01.652349 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.652316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:01.652535 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.652410 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:01.652535 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.652462 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:01.652535 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.652478 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:01.652535 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.652486 2578 projected.go:196] Error preparing data for projected volume kube-api-access-zw45s for pod openshift-network-diagnostics/network-check-target-dp8t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:01.652535 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.652468 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:43:02.652453101 +0000 UTC m=+4.031486232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:01.652719 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.652530 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s podName:791d38b1-bef1-4dcc-b291-094e971360d4 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:02.652517779 +0000 UTC m=+4.031550910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zw45s" (UniqueName: "kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s") pod "network-check-target-dp8t9" (UID: "791d38b1-bef1-4dcc-b291-094e971360d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:01.752909 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:01.752879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:01.753050 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.753009 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:01.753086 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:01.753061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret podName:9b3764ca-d808-4095-be9a-b4fd91464d36 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:02.753045978 +0000 UTC m=+4.132079110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret") pod "global-pull-secret-syncer-fqn8r" (UID: "9b3764ca-d808-4095-be9a-b4fd91464d36") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:02.074580 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.074503 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 09:38:01 +0000 UTC" deadline="2028-05-07 22:02:54.328160916 +0000 UTC" Sep 09 09:43:02.074580 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.074529 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14556h19m52.253635218s" Sep 09 09:43:02.098875 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.098855 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7368ba37_5e70_4a5b_b7dc_b7b825f0506a.slice/crio-cd88ffd15c298d3913cb4cd7cab8fb407f0ca95927ad7fdcbab95fa3da3163c7 WatchSource:0}: Error finding container cd88ffd15c298d3913cb4cd7cab8fb407f0ca95927ad7fdcbab95fa3da3163c7: Status 404 returned error can't find the container with id cd88ffd15c298d3913cb4cd7cab8fb407f0ca95927ad7fdcbab95fa3da3163c7 Sep 09 09:43:02.100453 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.100429 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324840fe_3788_427b_889a_c24c0050fbe7.slice/crio-3d020732ac1921c902bb223bbfd411350865a20dc85a9948d585448dd4e8dc8b WatchSource:0}: Error finding container 3d020732ac1921c902bb223bbfd411350865a20dc85a9948d585448dd4e8dc8b: Status 404 returned error can't find the container with id 3d020732ac1921c902bb223bbfd411350865a20dc85a9948d585448dd4e8dc8b Sep 09 09:43:02.100916 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.100889 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfe0ee4_93b6_4254_94f4_9d8fbdffffbb.slice/crio-0073f12444879e8209a3b3e0f23d8d74ced1a3dd3a9bb5e696fd1ca624da494a WatchSource:0}: Error finding container 0073f12444879e8209a3b3e0f23d8d74ced1a3dd3a9bb5e696fd1ca624da494a: Status 404 returned error can't find the container with id 0073f12444879e8209a3b3e0f23d8d74ced1a3dd3a9bb5e696fd1ca624da494a Sep 09 09:43:02.102803 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.102345 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66177ba_7509_4511_985b_d0c6c8734c78.slice/crio-2e679ea5f851c1f7c58aaf0c1b0e3d4e4708cd99ee1caf74a85c71a5a1f94732 WatchSource:0}: Error finding container 2e679ea5f851c1f7c58aaf0c1b0e3d4e4708cd99ee1caf74a85c71a5a1f94732: Status 404 returned error can't find the container with id 2e679ea5f851c1f7c58aaf0c1b0e3d4e4708cd99ee1caf74a85c71a5a1f94732 Sep 09 09:43:02.124312 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.124292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:02.124617 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.124410 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:02.126940 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.126922 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod269a7999_e486_4a0f_bfc5_4bc9265dbbb1.slice/crio-08f647e10d099fa1783ce0f8a9f295f5f4350db149939cd3e31ab333365806b2 WatchSource:0}: Error finding container 08f647e10d099fa1783ce0f8a9f295f5f4350db149939cd3e31ab333365806b2: Status 404 returned error can't find the container with id 08f647e10d099fa1783ce0f8a9f295f5f4350db149939cd3e31ab333365806b2 Sep 09 09:43:02.127691 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.127649 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41645d37_fbb5_44c9_8ba5_6b4cc17ecddc.slice/crio-efc38a046027a034bd1e623d6662c99ad56e125942b3b3c0f16075abcae44bc4 WatchSource:0}: Error finding container efc38a046027a034bd1e623d6662c99ad56e125942b3b3c0f16075abcae44bc4: Status 404 returned error can't find the container with id efc38a046027a034bd1e623d6662c99ad56e125942b3b3c0f16075abcae44bc4 Sep 09 09:43:02.128881 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.128861 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115373a4_d985_4d4e_b351_c3b00021f042.slice/crio-bae6bc51cb809804d9f0f254877959d6a77311a545075d198451bd513b4b8bc2 WatchSource:0}: Error finding container bae6bc51cb809804d9f0f254877959d6a77311a545075d198451bd513b4b8bc2: Status 404 returned error can't find the container with id bae6bc51cb809804d9f0f254877959d6a77311a545075d198451bd513b4b8bc2 Sep 09 09:43:02.129298 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.129282 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4e5afb_d9be_4150_9620_64453bb7c048.slice/crio-4ff98cab9125cdc831cbc55e2eb32ae213d0317a94fbd089b350dd5612289afb WatchSource:0}: Error finding container 4ff98cab9125cdc831cbc55e2eb32ae213d0317a94fbd089b350dd5612289afb: Status 404 returned error can't find the container with id 4ff98cab9125cdc831cbc55e2eb32ae213d0317a94fbd089b350dd5612289afb Sep 09 09:43:02.130495 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:02.130479 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1606604c_8f1c_45e7_9350_0cbcbed9c931.slice/crio-e670ed32345b82fa4157721874534b526a31ce6eb50c0796467a52a2b57af483 WatchSource:0}: Error finding container e670ed32345b82fa4157721874534b526a31ce6eb50c0796467a52a2b57af483: Status 404 returned error can't find the container with id e670ed32345b82fa4157721874534b526a31ce6eb50c0796467a52a2b57af483 Sep 09 09:43:02.138461 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.138437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9jszf" event={"ID":"41645d37-fbb5-44c9-8ba5-6b4cc17ecddc","Type":"ContainerStarted","Data":"efc38a046027a034bd1e623d6662c99ad56e125942b3b3c0f16075abcae44bc4"} Sep 09 09:43:02.140148 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.140122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" event={"ID":"115373a4-d985-4d4e-b351-c3b00021f042","Type":"ContainerStarted","Data":"bae6bc51cb809804d9f0f254877959d6a77311a545075d198451bd513b4b8bc2"} Sep 09 09:43:02.141570 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.141547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vxccb" event={"ID":"269a7999-e486-4a0f-bfc5-4bc9265dbbb1","Type":"ContainerStarted","Data":"08f647e10d099fa1783ce0f8a9f295f5f4350db149939cd3e31ab333365806b2"} Sep 09 09:43:02.142741 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.142718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" event={"ID":"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb","Type":"ContainerStarted","Data":"0073f12444879e8209a3b3e0f23d8d74ced1a3dd3a9bb5e696fd1ca624da494a"} Sep 09 09:43:02.143828 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.143810 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"2e679ea5f851c1f7c58aaf0c1b0e3d4e4708cd99ee1caf74a85c71a5a1f94732"} Sep 09 09:43:02.144839 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.144820 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s8b84" event={"ID":"7368ba37-5e70-4a5b-b7dc-b7b825f0506a","Type":"ContainerStarted","Data":"cd88ffd15c298d3913cb4cd7cab8fb407f0ca95927ad7fdcbab95fa3da3163c7"} Sep 09 09:43:02.146192 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.146170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzpqw" event={"ID":"6a4e5afb-d9be-4150-9620-64453bb7c048","Type":"ContainerStarted","Data":"4ff98cab9125cdc831cbc55e2eb32ae213d0317a94fbd089b350dd5612289afb"} Sep 09 09:43:02.147383 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.147365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mcr6f" event={"ID":"324840fe-3788-427b-889a-c24c0050fbe7","Type":"ContainerStarted","Data":"3d020732ac1921c902bb223bbfd411350865a20dc85a9948d585448dd4e8dc8b"} Sep 09 09:43:02.661117 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.660993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:02.661117 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.661054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:02.661417 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.661228 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:02.661417 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.661248 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:02.661417 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.661260 2578 projected.go:196] Error preparing data for projected volume kube-api-access-zw45s for pod openshift-network-diagnostics/network-check-target-dp8t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:02.661417 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.661312 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s podName:791d38b1-bef1-4dcc-b291-094e971360d4 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:04.661294964 +0000 UTC m=+6.040328111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zw45s" (UniqueName: "kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s") pod "network-check-target-dp8t9" (UID: "791d38b1-bef1-4dcc-b291-094e971360d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:02.661707 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.661671 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:02.661763 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.661741 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:43:04.661724829 +0000 UTC m=+6.040757974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:02.762220 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:02.761710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:02.762220 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.761861 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:02.762220 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:02.761915 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret podName:9b3764ca-d808-4095-be9a-b4fd91464d36 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:04.76189807 +0000 UTC m=+6.140931207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret") pod "global-pull-secret-syncer-fqn8r" (UID: "9b3764ca-d808-4095-be9a-b4fd91464d36") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:03.074922 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:03.074862 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 09:38:01 +0000 UTC" deadline="2028-06-08 12:36:14.126502742 +0000 UTC" Sep 09 09:43:03.074922 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:03.074921 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15314h53m11.051586513s" Sep 09 09:43:03.125957 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:03.125929 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:03.126104 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:03.126056 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:03.126165 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:03.126132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:03.126221 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:03.126208 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:03.168744 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:03.168035 2578 generic.go:356] "Generic (PLEG): container finished" podID="e4729ed97ef7a8c38fc61d9b5517096f" containerID="1ff96ba00b4465f6d62906b60a7111acf1ce57c5c3cbb4e239c6cc80540a8ed5" exitCode=0 Sep 09 09:43:03.168744 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:03.168120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"e4729ed97ef7a8c38fc61d9b5517096f","Type":"ContainerDied","Data":"1ff96ba00b4465f6d62906b60a7111acf1ce57c5c3cbb4e239c6cc80540a8ed5"} Sep 09 09:43:03.177217 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:03.177159 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerStarted","Data":"e670ed32345b82fa4157721874534b526a31ce6eb50c0796467a52a2b57af483"} Sep 09 09:43:03.180838 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:03.180789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" event={"ID":"728b04a33548859b274bbec2cc5b3fee","Type":"ContainerStarted","Data":"2e9ef3001934ba86505513ae65dd8c327fd009201ff25773e5346f26b914c784"} Sep 09 09:43:04.124448 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:04.124414 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:04.124984 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.124566 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:04.207777 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:04.207746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"e4729ed97ef7a8c38fc61d9b5517096f","Type":"ContainerStarted","Data":"d57ed22b72f759bad567acb787c05bac65995443d94b0c9dccf8d6fcd53e0b65"} Sep 09 09:43:04.224258 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:04.223982 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" podStartSLOduration=4.223963329 podStartE2EDuration="4.223963329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:43:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:03.197606956 +0000 UTC m=+4.576640113" watchObservedRunningTime="2026-09-09 09:43:04.223963329 +0000 UTC m=+5.602996485" Sep 09 09:43:04.675827 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:04.675574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:04.676062 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:04.675855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:04.676062 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.675993 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:04.676062 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.676006 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:04.676062 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.676016 2578 projected.go:196] Error preparing data for projected volume kube-api-access-zw45s for pod openshift-network-diagnostics/network-check-target-dp8t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:04.676275 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.676069 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s podName:791d38b1-bef1-4dcc-b291-094e971360d4 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:08.676048949 +0000 UTC m=+10.055082098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zw45s" (UniqueName: "kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s") pod "network-check-target-dp8t9" (UID: "791d38b1-bef1-4dcc-b291-094e971360d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:04.676501 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.676474 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:04.676637 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.676530 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:43:08.676514416 +0000 UTC m=+10.055547554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:04.777174 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:04.777127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:04.777335 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.777318 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:04.777395 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:04.777376 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret podName:9b3764ca-d808-4095-be9a-b4fd91464d36 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:08.777359577 +0000 UTC m=+10.156392714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret") pod "global-pull-secret-syncer-fqn8r" (UID: "9b3764ca-d808-4095-be9a-b4fd91464d36") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:05.126714 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:05.126618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:05.127222 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:05.126763 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:05.127222 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:05.127125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:05.127222 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:05.127215 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:06.123868 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:06.123818 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:06.124070 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:06.123963 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:07.126232 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:07.125577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:07.126232 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:07.125723 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:07.126232 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:07.126090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:07.126232 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:07.126175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:08.124201 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:08.124090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:08.124333 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.124246 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:08.709550 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:08.709514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:08.709940 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:08.709569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:08.709940 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.709769 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:08.709940 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.709790 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:08.709940 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.709799 2578 projected.go:196] Error preparing data for projected volume kube-api-access-zw45s for pod openshift-network-diagnostics/network-check-target-dp8t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:08.709940 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.709840 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s podName:791d38b1-bef1-4dcc-b291-094e971360d4 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:16.709826741 +0000 UTC m=+18.088859886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zw45s" (UniqueName: "kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s") pod "network-check-target-dp8t9" (UID: "791d38b1-bef1-4dcc-b291-094e971360d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:08.710201 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.710182 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:08.710284 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.710245 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:43:16.710228446 +0000 UTC m=+18.089261588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:08.810880 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:08.810363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:08.810880 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.810502 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:08.810880 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:08.810554 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret podName:9b3764ca-d808-4095-be9a-b4fd91464d36 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:16.810537603 +0000 UTC m=+18.189570748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret") pod "global-pull-secret-syncer-fqn8r" (UID: "9b3764ca-d808-4095-be9a-b4fd91464d36") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:09.124945 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:09.124357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:09.124945 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:09.124474 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:09.124945 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:09.124797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:09.124945 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:09.124873 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:10.124267 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:10.124236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:10.124653 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:10.124365 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:11.123689 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:11.123638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:11.123909 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:11.123797 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:11.124197 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:11.124179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:11.124328 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:11.124273 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:12.123926 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:12.123889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:12.124111 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:12.124028 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:13.124477 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:13.124438 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:13.124926 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:13.124582 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:13.125010 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:13.124991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:13.125103 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:13.125083 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:14.123450 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:14.123412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:14.123642 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:14.123560 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:15.124039 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:15.124005 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:15.124417 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:15.124132 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:15.124417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:15.124224 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:15.124417 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:15.124346 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:16.124143 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:16.124068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:16.124542 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.124179 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:16.765396 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:16.765349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:16.765587 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:16.765414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:16.765587 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.765516 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:16.765587 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.765543 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:16.765587 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.765562 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:16.765587 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.765575 2578 projected.go:196] Error preparing data for projected volume kube-api-access-zw45s for pod openshift-network-diagnostics/network-check-target-dp8t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:16.765809 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.765597 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:43:32.765574999 +0000 UTC m=+34.144608147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:16.765809 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.765622 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s podName:791d38b1-bef1-4dcc-b291-094e971360d4 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:32.765610635 +0000 UTC m=+34.144643780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zw45s" (UniqueName: "kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s") pod "network-check-target-dp8t9" (UID: "791d38b1-bef1-4dcc-b291-094e971360d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:16.866212 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:16.866089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:16.866380 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.866252 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:16.866380 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:16.866324 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret podName:9b3764ca-d808-4095-be9a-b4fd91464d36 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:32.866305975 +0000 UTC m=+34.245339125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret") pod "global-pull-secret-syncer-fqn8r" (UID: "9b3764ca-d808-4095-be9a-b4fd91464d36") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:17.123967 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:17.123935 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:17.124139 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:17.124054 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:17.124139 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:17.124118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:17.124519 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:17.124228 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:18.124209 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:18.124176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:18.124629 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:18.124290 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:19.125054 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:19.125028 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:19.125466 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:19.125137 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:19.125466 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:19.125231 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:19.125466 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:19.125368 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:20.127048 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.125642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:20.127048 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:20.125819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:20.242777 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.242744 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" event={"ID":"0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb","Type":"ContainerStarted","Data":"6ab302ae5eef434b579deb8a4ca20b7afa5643e35811f945f3e4a6c16251e7ed"} Sep 09 09:43:20.244583 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.244552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"8770c1b4cdaf03b4d3bb9e287c37a7b5c86ba1209ba3e99540a7522b51547972"} Sep 09 09:43:20.246847 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.246821 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s8b84" event={"ID":"7368ba37-5e70-4a5b-b7dc-b7b825f0506a","Type":"ContainerStarted","Data":"c5c948281421d0c29aa101000a5e199528ae44a20dd3f9746be0e7c35002f291"} Sep 09 09:43:20.249343 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.249319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerStarted","Data":"3145568c6dce4f0110e591efd89cc2675354753b76a57b5ba43781c7774e40de"} Sep 09 09:43:20.251387 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.251340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzpqw" event={"ID":"6a4e5afb-d9be-4150-9620-64453bb7c048","Type":"ContainerStarted","Data":"d0f8bbf59db0fa2cb08cf37ede3be4acf37e1b2e7e7eeb03775ed27ddf29fe63"} Sep 09 09:43:20.253446 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.253232 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9jszf" event={"ID":"41645d37-fbb5-44c9-8ba5-6b4cc17ecddc","Type":"ContainerStarted","Data":"f47b77a9e917ad8e5d0845c7a0227bdf1b6930cab7f755dbe0849836eb77e503"} Sep 09 09:43:20.257069 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.257028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vxccb" event={"ID":"269a7999-e486-4a0f-bfc5-4bc9265dbbb1","Type":"ContainerStarted","Data":"fddd64f755abc613dc3e6ce5b0589136bbcda7d0a54cc608279296fff269921d"} Sep 09 09:43:20.265196 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.264102 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" podStartSLOduration=20.264086124 podStartE2EDuration="20.264086124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:43:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:04.224432523 +0000 UTC m=+5.603465708" watchObservedRunningTime="2026-09-09 09:43:20.264086124 +0000 UTC m=+21.643119279" Sep 09 09:43:20.265196 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.264730 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zdmm8" podStartSLOduration=3.4289166460000002 podStartE2EDuration="21.264718842s" totalImagesPullingTime="17.835802196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:20.264290897 +0000 UTC m=+21.643324053" watchObservedRunningTime="2026-09-09 09:43:20.264718842 +0000 UTC m=+21.643751997" Sep 09 09:43:20.296139 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.296051 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9jszf" podStartSLOduration=7.557089353 podStartE2EDuration="21.296034447s" totalImagesPullingTime="13.738945094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:20.295602022 +0000 UTC m=+21.674635190" watchObservedRunningTime="2026-09-09 09:43:20.296034447 +0000 UTC m=+21.675067601" Sep 09 09:43:20.325630 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.325578 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s8b84" podStartSLOduration=3.467197853 podStartE2EDuration="21.325564716s" totalImagesPullingTime="17.858366863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:20.325285453 +0000 UTC m=+21.704318607" watchObservedRunningTime="2026-09-09 09:43:20.325564716 +0000 UTC m=+21.704597871" Sep 09 09:43:20.325949 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.325921 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bzpqw" podStartSLOduration=3.462348727 podStartE2EDuration="21.325912324s" totalImagesPullingTime="17.863563597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:20.31215831 +0000 UTC m=+21.691191496" watchObservedRunningTime="2026-09-09 09:43:20.325912324 +0000 UTC m=+21.704945477" Sep 09 09:43:20.340575 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:20.338544 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vxccb" podStartSLOduration=3.511338159 podStartE2EDuration="21.338522485s" totalImagesPullingTime="17.827184326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:20.337704737 +0000 UTC m=+21.716737912" watchObservedRunningTime="2026-09-09 09:43:20.338522485 +0000 UTC m=+21.717555640" Sep 09 09:43:21.123830 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.123632 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:21.124014 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.123699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:21.124014 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:21.123940 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:21.124136 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:21.124027 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:21.128093 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.128074 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 09:43:21.260590 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.260565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" event={"ID":"115373a4-d985-4d4e-b351-c3b00021f042","Type":"ContainerStarted","Data":"7c96a7853c71fd4846a83bb8a7461a8fb2ca70758cd5183ae377ae36037604ac"} Sep 09 09:43:21.260705 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.260614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" event={"ID":"115373a4-d985-4d4e-b351-c3b00021f042","Type":"ContainerStarted","Data":"784cec61e7c9f7e1c5605ea3803cbd01f96c8b09e3fda91d73eb1837a1f8f1da"} Sep 09 09:43:21.263583 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.263553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"0c75828e483698a946f88f2c3e9f9a48e3b6543540e09936ca9505ba4cb5d270"} Sep 09 09:43:21.263697 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.263612 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"02986f975720dd682351aba02f7fc861e3a73df63643581a78d6bc4f68a9441e"} Sep 09 09:43:21.263697 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.263643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"7424870085eef4697c89c6b639e9def8a944464123b5b508e53ac24bc4dadda1"} Sep 09 09:43:21.263797 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.263703 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"c8462e9126e7e980dd7c737a0ce2ad311b02f50c121dd5398413414d47421c7d"} Sep 09 09:43:21.263797 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.263731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"d80f28a30ed88d94aa93a836c3c860efe6509b36fd558ca2cd01464a84e4bbde"} Sep 09 09:43:21.265041 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.265020 2578 generic.go:356] "Generic (PLEG): container finished" podID="1606604c-8f1c-45e7-9350-0cbcbed9c931" containerID="3145568c6dce4f0110e591efd89cc2675354753b76a57b5ba43781c7774e40de" exitCode=0 Sep 09 09:43:21.265125 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.265099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerDied","Data":"3145568c6dce4f0110e591efd89cc2675354753b76a57b5ba43781c7774e40de"} Sep 09 09:43:21.266706 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.266667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mcr6f" event={"ID":"324840fe-3788-427b-889a-c24c0050fbe7","Type":"ContainerStarted","Data":"0f847472eca484ef294360b42ebb79c5d1921725f470ff247c59f9cac6f264e0"} Sep 09 09:43:21.298292 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:21.298224 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mcr6f" podStartSLOduration=4.441523441 podStartE2EDuration="22.298211234s" totalImagesPullingTime="17.856687793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:21.297688815 +0000 UTC m=+22.676721979" watchObservedRunningTime="2026-09-09 09:43:21.298211234 +0000 UTC m=+22.677244387" Sep 09 09:43:22.095417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.095379 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:22.096022 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.096001 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:22.103214 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.103137 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T09:43:21.128090409Z","UUID":"d7305140-bf2a-427d-bd18-b30fe18934d6","Handler":null,"Name":"","Endpoint":""} Sep 09 09:43:22.104983 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.104952 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 09:43:22.104983 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.104985 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 09:43:22.124456 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.124434 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:22.124581 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:22.124559 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:22.271785 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.271705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" event={"ID":"115373a4-d985-4d4e-b351-c3b00021f042","Type":"ContainerStarted","Data":"8eefb357b5bca47780cd480fd3ac2f0fdd7eaf71dc6889e100f727dca769099f"} Sep 09 09:43:22.288140 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.288094 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25qwt" podStartSLOduration=3.900300235 podStartE2EDuration="23.288079044s" totalImagesPullingTime="19.387778809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:22.287589877 +0000 UTC m=+23.666623052" watchObservedRunningTime="2026-09-09 09:43:22.288079044 +0000 UTC m=+23.667112197" Sep 09 09:43:22.486888 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.486853 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:22.487432 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:22.487414 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9jszf" Sep 09 09:43:23.123992 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:23.123965 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:23.124175 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:23.123963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:23.124175 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:23.124074 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:23.124283 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:23.124203 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:23.278187 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:23.278141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"51d1bd6552222aaaadaba2fdbdba840e9e2dee5ed96346a547b79f7bc580b375"} Sep 09 09:43:24.123864 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:24.123837 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:24.124051 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:24.123954 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:25.123968 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:25.123937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:25.124412 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:25.124051 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:25.124412 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:25.124116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:25.124412 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:25.124224 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:26.124249 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:26.124091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:26.124818 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:26.124322 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:26.287118 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:26.287090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" event={"ID":"a66177ba-7509-4511-985b-d0c6c8734c78","Type":"ContainerStarted","Data":"b2e3ceef63f0ea7d6363677e1b85fcbe845564e4d71df83acaf4ff030deff6ab"} Sep 09 09:43:26.287388 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:26.287360 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:26.287489 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:26.287441 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:26.288922 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:26.288899 2578 generic.go:356] "Generic (PLEG): container finished" podID="1606604c-8f1c-45e7-9350-0cbcbed9c931" containerID="5a35f9ae7fa772ca54d6da596731ebaadbc531f3de8974046631b09e03e7ceb1" exitCode=0 Sep 09 09:43:26.289041 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:26.288927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerDied","Data":"5a35f9ae7fa772ca54d6da596731ebaadbc531f3de8974046631b09e03e7ceb1"} Sep 09 09:43:26.303179 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:26.303161 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:26.311955 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:26.311916 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" podStartSLOduration=9.304446934 podStartE2EDuration="27.311903587s" totalImagesPullingTime="18.007456653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:26.310363854 +0000 UTC m=+27.689397009" watchObservedRunningTime="2026-09-09 09:43:26.311903587 +0000 UTC m=+27.690936741" Sep 09 09:43:27.124082 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.124057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:27.124181 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.124088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:27.124218 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:27.124176 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:27.124303 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:27.124285 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:27.291911 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.291697 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:27.307059 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.307033 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:27.342215 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.342187 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dp8t9"] Sep 09 09:43:27.342366 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.342289 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:27.342444 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:27.342400 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:27.343001 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.342861 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g26bw"] Sep 09 09:43:27.343001 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.342973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:27.343168 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:27.343065 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:27.343490 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.343472 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fqn8r"] Sep 09 09:43:27.343577 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:27.343567 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:27.343696 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:27.343660 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:29.124651 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:29.124562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:29.125116 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:29.124657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:29.125116 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:29.124706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:29.125116 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:29.124705 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:29.125116 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:29.124783 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:29.125116 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:29.124852 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:29.298093 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:29.298065 2578 generic.go:356] "Generic (PLEG): container finished" podID="1606604c-8f1c-45e7-9350-0cbcbed9c931" containerID="c3b97010d74a3208a2bddad2b846f865381cf0e071f923aff9fd9f2c48baca9a" exitCode=0 Sep 09 09:43:29.298227 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:29.298145 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerDied","Data":"c3b97010d74a3208a2bddad2b846f865381cf0e071f923aff9fd9f2c48baca9a"} Sep 09 09:43:31.124113 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:31.124081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:31.124519 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:31.124089 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:31.124519 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:31.124172 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqn8r" podUID="9b3764ca-d808-4095-be9a-b4fd91464d36" Sep 09 09:43:31.124519 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:31.124233 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dp8t9" podUID="791d38b1-bef1-4dcc-b291-094e971360d4" Sep 09 09:43:31.124519 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:31.124262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:31.124519 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:31.124371 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:43:31.305923 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:31.305892 2578 generic.go:356] "Generic (PLEG): container finished" podID="1606604c-8f1c-45e7-9350-0cbcbed9c931" containerID="71ef3ba315e11cbd3cb1b25cd11d100a49044368513cad83f79904a2c49e8427" exitCode=0 Sep 09 09:43:31.306071 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:31.305933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerDied","Data":"71ef3ba315e11cbd3cb1b25cd11d100a49044368513cad83f79904a2c49e8427"} Sep 09 09:43:32.781709 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.781652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:32.782157 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.781719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:32.782157 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:32.781806 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:32.782157 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:32.781850 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:32.782157 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:32.781867 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:44:04.78184686 +0000 UTC m=+66.160879992 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:32.782157 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:32.781874 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:32.782157 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:32.781887 2578 projected.go:196] Error preparing data for projected volume kube-api-access-zw45s for pod openshift-network-diagnostics/network-check-target-dp8t9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:32.782157 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:32.781936 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s podName:791d38b1-bef1-4dcc-b291-094e971360d4 nodeName:}" failed. No retries permitted until 2026-09-09 09:44:04.781919667 +0000 UTC m=+66.160952812 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zw45s" (UniqueName: "kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s") pod "network-check-target-dp8t9" (UID: "791d38b1-bef1-4dcc-b291-094e971360d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:32.858303 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.858279 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeReady" Sep 09 09:43:32.858460 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.858420 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 09:43:32.882414 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.882392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:32.882564 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:32.882545 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:32.882628 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:32.882599 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret podName:9b3764ca-d808-4095-be9a-b4fd91464d36 nodeName:}" failed. No retries permitted until 2026-09-09 09:44:04.882585424 +0000 UTC m=+66.261618557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret") pod "global-pull-secret-syncer-fqn8r" (UID: "9b3764ca-d808-4095-be9a-b4fd91464d36") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:32.898114 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.898089 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wgslx"] Sep 09 09:43:32.919508 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.919485 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r55m5"] Sep 09 09:43:32.920022 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.919999 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:32.923123 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.922852 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25h6q\"" Sep 09 09:43:32.923123 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.922991 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 09:43:32.923123 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.923103 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 09:43:32.933389 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.933370 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wgslx"] Sep 09 09:43:32.933470 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.933405 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r55m5"] Sep 09 09:43:32.933512 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.933484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r55m5" Sep 09 09:43:32.936356 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.936335 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 09:43:32.936454 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.936393 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-clsms\"" Sep 09 09:43:32.936454 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.936421 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 09:43:32.936541 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:32.936335 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 09:43:33.084474 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.084441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc29d55-4502-44b6-b15e-13bca7c9e4e0-cert\") pod \"ingress-canary-r55m5\" (UID: \"4dc29d55-4502-44b6-b15e-13bca7c9e4e0\") " pod="openshift-ingress-canary/ingress-canary-r55m5" Sep 09 09:43:33.084643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.084490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.084643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.084596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnsxv\" (UniqueName: \"kubernetes.io/projected/4548e955-dc4a-4933-a001-59047b181ea1-kube-api-access-nnsxv\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.084643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.084626 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwx8t\" (UniqueName: \"kubernetes.io/projected/4dc29d55-4502-44b6-b15e-13bca7c9e4e0-kube-api-access-nwx8t\") pod \"ingress-canary-r55m5\" (UID: \"4dc29d55-4502-44b6-b15e-13bca7c9e4e0\") " pod="openshift-ingress-canary/ingress-canary-r55m5" Sep 09 09:43:33.084832 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.084668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4548e955-dc4a-4933-a001-59047b181ea1-tmp-dir\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.084832 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.084730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4548e955-dc4a-4933-a001-59047b181ea1-config-volume\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.124131 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.124055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:43:33.124131 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.124079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:43:33.124131 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.124057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:43:33.126938 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.126914 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 09:43:33.127056 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.126969 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wwtw\"" Sep 09 09:43:33.127056 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.127022 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 09:43:33.127170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.127053 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 09:43:33.127170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.126973 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 09:43:33.127170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.127158 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pm74b\"" Sep 09 09:43:33.185696 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.185663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.185831 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.185733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnsxv\" (UniqueName: \"kubernetes.io/projected/4548e955-dc4a-4933-a001-59047b181ea1-kube-api-access-nnsxv\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.185831 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.185760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwx8t\" (UniqueName: \"kubernetes.io/projected/4dc29d55-4502-44b6-b15e-13bca7c9e4e0-kube-api-access-nwx8t\") pod \"ingress-canary-r55m5\" (UID: \"4dc29d55-4502-44b6-b15e-13bca7c9e4e0\") " pod="openshift-ingress-canary/ingress-canary-r55m5" Sep 09 09:43:33.185831 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.185799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4548e955-dc4a-4933-a001-59047b181ea1-tmp-dir\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.185991 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:33.185827 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:33.185991 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:33.185887 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:33.685871704 +0000 UTC m=+35.064904841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:43:33.186102 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.185831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4548e955-dc4a-4933-a001-59047b181ea1-config-volume\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.186155 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.186112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc29d55-4502-44b6-b15e-13bca7c9e4e0-cert\") pod \"ingress-canary-r55m5\" (UID: \"4dc29d55-4502-44b6-b15e-13bca7c9e4e0\") " pod="openshift-ingress-canary/ingress-canary-r55m5" Sep 09 09:43:33.186326 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.186309 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4548e955-dc4a-4933-a001-59047b181ea1-config-volume\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.186806 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.186787 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4548e955-dc4a-4933-a001-59047b181ea1-tmp-dir\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.190929 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.190909 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc29d55-4502-44b6-b15e-13bca7c9e4e0-cert\") pod \"ingress-canary-r55m5\" (UID: \"4dc29d55-4502-44b6-b15e-13bca7c9e4e0\") " pod="openshift-ingress-canary/ingress-canary-r55m5" Sep 09 09:43:33.194404 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.194377 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwx8t\" (UniqueName: \"kubernetes.io/projected/4dc29d55-4502-44b6-b15e-13bca7c9e4e0-kube-api-access-nwx8t\") pod \"ingress-canary-r55m5\" (UID: \"4dc29d55-4502-44b6-b15e-13bca7c9e4e0\") " pod="openshift-ingress-canary/ingress-canary-r55m5" Sep 09 09:43:33.194562 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.194543 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnsxv\" (UniqueName: \"kubernetes.io/projected/4548e955-dc4a-4933-a001-59047b181ea1-kube-api-access-nnsxv\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.242688 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.242657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r55m5" Sep 09 09:43:33.569624 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.569551 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r55m5"] Sep 09 09:43:33.573308 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:43:33.573279 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc29d55_4502_44b6_b15e_13bca7c9e4e0.slice/crio-54e4de2b37cf34b5f105f4b76e2e31c53867f00342d484d0837d889a4adeccf9 WatchSource:0}: Error finding container 54e4de2b37cf34b5f105f4b76e2e31c53867f00342d484d0837d889a4adeccf9: Status 404 returned error can't find the container with id 54e4de2b37cf34b5f105f4b76e2e31c53867f00342d484d0837d889a4adeccf9 Sep 09 09:43:33.689761 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.689730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:33.689940 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:33.689866 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:33.690004 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:33.689942 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:34.689918932 +0000 UTC m=+36.068952081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:43:33.813127 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.813082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:33.898664 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:33.898582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:34.314380 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:34.314345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r55m5" event={"ID":"4dc29d55-4502-44b6-b15e-13bca7c9e4e0","Type":"ContainerStarted","Data":"54e4de2b37cf34b5f105f4b76e2e31c53867f00342d484d0837d889a4adeccf9"} Sep 09 09:43:34.701228 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:34.698059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:34.701228 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:34.698339 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:34.701228 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:34.698450 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:36.698414487 +0000 UTC m=+38.077449697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:43:34.799552 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:34.799513 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:34.900697 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:34.900658 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:35.292555 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:35.292507 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:35.352569 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:35.352537 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:35.587904 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:35.587872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:35.689552 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:35.689528 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:36.321736 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:36.321519 2578 generic.go:356] "Generic (PLEG): container finished" podID="1606604c-8f1c-45e7-9350-0cbcbed9c931" containerID="7e7bfb1fa404ff440c140bfa9c8dba6f687c0087f70099ef8be7d3c8d9ab2bfa" exitCode=0 Sep 09 09:43:36.322205 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:36.321601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerDied","Data":"7e7bfb1fa404ff440c140bfa9c8dba6f687c0087f70099ef8be7d3c8d9ab2bfa"} Sep 09 09:43:36.715918 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:36.715802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:36.716069 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:36.715980 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:36.716069 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:36.716065 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:40.716042103 +0000 UTC m=+42.095075240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:43:37.327756 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:37.327730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerStarted","Data":"9e46c8b0e18ec541837706d1ab6fff0df777a911fcb0877ea48dbbaa0ca5bc28"} Sep 09 09:43:38.337691 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.337638 2578 generic.go:356] "Generic (PLEG): container finished" podID="1606604c-8f1c-45e7-9350-0cbcbed9c931" containerID="9e46c8b0e18ec541837706d1ab6fff0df777a911fcb0877ea48dbbaa0ca5bc28" exitCode=0 Sep 09 09:43:38.338205 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.337716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerDied","Data":"9e46c8b0e18ec541837706d1ab6fff0df777a911fcb0877ea48dbbaa0ca5bc28"} Sep 09 09:43:38.338205 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.337809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" event={"ID":"1606604c-8f1c-45e7-9350-0cbcbed9c931","Type":"ContainerStarted","Data":"43fc40d2d1e94edb7af066bd2e4424cbee57877354a299e4054892d99496e476"} Sep 09 09:43:38.339360 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.339337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r55m5" event={"ID":"4dc29d55-4502-44b6-b15e-13bca7c9e4e0","Type":"ContainerStarted","Data":"b40bb6bd79dde7b00275bcd34799d4be4db97a1baa45ff7be9d3aaab88e604f1"} Sep 09 09:43:38.343203 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.343176 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:38.358524 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.358487 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f6sfs" podStartSLOduration=9.832984989 podStartE2EDuration="39.358475374s" totalImagesPullingTime="29.525490385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:38.358061889 +0000 UTC m=+39.737095054" watchObservedRunningTime="2026-09-09 09:43:38.358475374 +0000 UTC m=+39.737508528" Sep 09 09:43:38.372404 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.372368 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r55m5" podStartSLOduration=2.253138725 podStartE2EDuration="6.372355218s" totalImagesPullingTime="4.119216493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:38.37188468 +0000 UTC m=+39.750917852" watchObservedRunningTime="2026-09-09 09:43:38.372355218 +0000 UTC m=+39.751388363" Sep 09 09:43:38.447173 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.447147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:38.949753 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:38.949730 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:40.746640 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:40.746608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:40.747017 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:40.746755 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:40.747017 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:40.746814 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:43:48.746799346 +0000 UTC m=+50.125832478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:43:48.805798 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:48.805764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:43:48.806245 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:48.805913 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:48.806245 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:43:48.805985 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:44:04.805969917 +0000 UTC m=+66.185003049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:43:55.261600 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:55.261566 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:55.321447 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:55.321420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:56.796436 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:56.796406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:56.895820 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:56.895787 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:59.309183 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:59.309152 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sbpcq" Sep 09 09:43:59.416343 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:59.416315 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:43:59.477062 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:43:59.477040 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:44:04.809478 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.809445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:44:04.809478 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.809482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:44:04.809948 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.809503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:44:04.809948 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:44:04.809612 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:44:04.809948 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:44:04.809718 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:44:36.809697082 +0000 UTC m=+98.188730228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:44:04.812409 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.812388 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 09:44:04.812532 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.812472 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 09:44:04.820079 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:44:04.820053 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 09:44:04.820150 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:44:04.820105 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:45:08.820091196 +0000 UTC m=+130.199124329 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : secret "metrics-daemon-secret" not found Sep 09 09:44:04.822086 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.822069 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 09:44:04.833729 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.833708 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw45s\" (UniqueName: \"kubernetes.io/projected/791d38b1-bef1-4dcc-b291-094e971360d4-kube-api-access-zw45s\") pod \"network-check-target-dp8t9\" (UID: \"791d38b1-bef1-4dcc-b291-094e971360d4\") " pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:44:04.910853 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.910829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:44:04.913378 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.913359 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 09:44:04.923552 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.923532 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b3764ca-d808-4095-be9a-b4fd91464d36-original-pull-secret\") pod \"global-pull-secret-syncer-fqn8r\" (UID: \"9b3764ca-d808-4095-be9a-b4fd91464d36\") " pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:44:04.936628 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.936607 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqn8r" Sep 09 09:44:04.952142 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.952124 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pm74b\"" Sep 09 09:44:04.960353 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:04.960336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:44:05.207902 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:05.207822 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fqn8r"] Sep 09 09:44:05.212571 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:44:05.212539 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3764ca_d808_4095_be9a_b4fd91464d36.slice/crio-9c17877158106145e554e9ca284efb9f57a4ecaa024bccbbdd3cc996423c1502 WatchSource:0}: Error finding container 9c17877158106145e554e9ca284efb9f57a4ecaa024bccbbdd3cc996423c1502: Status 404 returned error can't find the container with id 9c17877158106145e554e9ca284efb9f57a4ecaa024bccbbdd3cc996423c1502 Sep 09 09:44:05.232714 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:05.232693 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dp8t9"] Sep 09 09:44:05.235456 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:44:05.235431 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791d38b1_bef1_4dcc_b291_094e971360d4.slice/crio-238f338dc755775535a88e7e47ba9f7a439a33fba94cc0a3e39c1821c85783ae WatchSource:0}: Error finding container 238f338dc755775535a88e7e47ba9f7a439a33fba94cc0a3e39c1821c85783ae: Status 404 returned error can't find the container with id 238f338dc755775535a88e7e47ba9f7a439a33fba94cc0a3e39c1821c85783ae Sep 09 09:44:05.399799 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:05.399766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dp8t9" event={"ID":"791d38b1-bef1-4dcc-b291-094e971360d4","Type":"ContainerStarted","Data":"238f338dc755775535a88e7e47ba9f7a439a33fba94cc0a3e39c1821c85783ae"} Sep 09 09:44:05.400880 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:05.400857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fqn8r" event={"ID":"9b3764ca-d808-4095-be9a-b4fd91464d36","Type":"ContainerStarted","Data":"9c17877158106145e554e9ca284efb9f57a4ecaa024bccbbdd3cc996423c1502"} Sep 09 09:44:09.464989 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:09.464924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:44:09.516378 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:09.516345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:44:10.416893 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:10.416857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dp8t9" event={"ID":"791d38b1-bef1-4dcc-b291-094e971360d4","Type":"ContainerStarted","Data":"6097408d8bfc2caa3e0b83579694d740fbdb532a875830774f7f488582f88ebf"} Sep 09 09:44:10.417125 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:10.416968 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:44:10.418394 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:10.418374 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fqn8r" event={"ID":"9b3764ca-d808-4095-be9a-b4fd91464d36","Type":"ContainerStarted","Data":"534f346f3b02f87d78e80c97ad278f7bee2cf75e87c32c5af5533043d2911b30"} Sep 09 09:44:10.431855 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:10.431716 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dp8t9" podStartSLOduration=66.686757489 podStartE2EDuration="1m11.43169962s" totalImagesPullingTime="4.744942131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:44:10.430811631 +0000 UTC m=+71.809844796" watchObservedRunningTime="2026-09-09 09:44:10.43169962 +0000 UTC m=+71.810732774" Sep 09 09:44:10.444169 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:10.444125 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fqn8r" podStartSLOduration=66.664860251 podStartE2EDuration="1m11.444110901s" totalImagesPullingTime="4.77925065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:44:10.443829113 +0000 UTC m=+71.822862267" watchObservedRunningTime="2026-09-09 09:44:10.444110901 +0000 UTC m=+71.823144057" Sep 09 09:44:36.816923 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:36.816810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:44:36.816923 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:44:36.816914 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:44:36.817327 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:44:36.816979 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:45:40.816960029 +0000 UTC m=+162.195993175 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:44:37.919117 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:37.919084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:44:37.967187 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:37.967153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:44:41.423603 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:41.423576 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dp8t9" Sep 09 09:44:46.634433 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.634402 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm"] Sep 09 09:44:46.638202 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.638186 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.640820 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.640798 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 09:44:46.641699 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.641671 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 09:44:46.641761 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.641689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 09 09:44:46.641761 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.641737 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 09:44:46.647093 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.647065 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm"] Sep 09 09:44:46.677661 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.677635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c60a532c-aae7-4f75-ae64-78312cc6048f-tmp\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.677763 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.677669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c60a532c-aae7-4f75-ae64-78312cc6048f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.677763 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.677708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4wpl\" (UniqueName: \"kubernetes.io/projected/c60a532c-aae7-4f75-ae64-78312cc6048f-kube-api-access-c4wpl\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.778011 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.777985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c60a532c-aae7-4f75-ae64-78312cc6048f-tmp\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.778112 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.778023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c60a532c-aae7-4f75-ae64-78312cc6048f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.778112 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.778059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4wpl\" (UniqueName: \"kubernetes.io/projected/c60a532c-aae7-4f75-ae64-78312cc6048f-kube-api-access-c4wpl\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.778459 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.778439 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c60a532c-aae7-4f75-ae64-78312cc6048f-tmp\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.780577 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.780556 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c60a532c-aae7-4f75-ae64-78312cc6048f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.786578 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.786560 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4wpl\" (UniqueName: \"kubernetes.io/projected/c60a532c-aae7-4f75-ae64-78312cc6048f-kube-api-access-c4wpl\") pod \"klusterlet-addon-workmgr-7c7b45764b-sndpm\" (UID: \"c60a532c-aae7-4f75-ae64-78312cc6048f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:46.947995 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:46.947897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:47.214844 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:47.214772 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm"] Sep 09 09:44:47.219050 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:44:47.219027 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60a532c_aae7_4f75_ae64_78312cc6048f.slice/crio-7dd19719c348c9d2221c8787c8bf529fdca923df862f57347289c9d1ecb01b9b WatchSource:0}: Error finding container 7dd19719c348c9d2221c8787c8bf529fdca923df862f57347289c9d1ecb01b9b: Status 404 returned error can't find the container with id 7dd19719c348c9d2221c8787c8bf529fdca923df862f57347289c9d1ecb01b9b Sep 09 09:44:47.509704 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:47.509583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" event={"ID":"c60a532c-aae7-4f75-ae64-78312cc6048f","Type":"ContainerStarted","Data":"7dd19719c348c9d2221c8787c8bf529fdca923df862f57347289c9d1ecb01b9b"} Sep 09 09:44:51.521384 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:51.521344 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" event={"ID":"c60a532c-aae7-4f75-ae64-78312cc6048f","Type":"ContainerStarted","Data":"97bbbc613d08026249ce66a899461450594ce788b196c5b88e542f6c656cb55e"} Sep 09 09:44:51.521773 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:51.521583 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:51.523054 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:51.523031 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:44:51.536930 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:44:51.536842 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" podStartSLOduration=2.083322867 podStartE2EDuration="5.536827635s" totalImagesPullingTime="3.453504768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:44:51.536822356 +0000 UTC m=+112.915855530" watchObservedRunningTime="2026-09-09 09:44:51.536827635 +0000 UTC m=+112.915860791" Sep 09 09:45:08.822758 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:45:08.822698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:45:08.823290 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:45:08.822835 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 09:45:08.823290 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:45:08.822945 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:10.822922849 +0000 UTC m=+252.201955999 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : secret "metrics-daemon-secret" not found Sep 09 09:45:35.931970 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:45:35.931916 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wgslx" podUID="4548e955-dc4a-4933-a001-59047b181ea1" Sep 09 09:45:36.145012 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:45:36.144973 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:45:36.629575 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:45:36.629546 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgslx" Sep 09 09:45:40.835936 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:45:40.835902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:45:40.836289 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:45:40.836002 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:45:40.836289 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:45:40.836066 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls podName:4548e955-dc4a-4933-a001-59047b181ea1 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:42.836050575 +0000 UTC m=+284.215083707 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls") pod "dns-default-wgslx" (UID: "4548e955-dc4a-4933-a001-59047b181ea1") : secret "dns-default-metrics-tls" not found Sep 09 09:45:49.125263 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:45:49.125224 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:46:50.809226 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:46:50.809193 2578 generic.go:356] "Generic (PLEG): container finished" podID="c60a532c-aae7-4f75-ae64-78312cc6048f" containerID="97bbbc613d08026249ce66a899461450594ce788b196c5b88e542f6c656cb55e" exitCode=1 Sep 09 09:46:50.809611 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:46:50.809263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" event={"ID":"c60a532c-aae7-4f75-ae64-78312cc6048f","Type":"ContainerDied","Data":"97bbbc613d08026249ce66a899461450594ce788b196c5b88e542f6c656cb55e"} Sep 09 09:46:50.809611 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:46:50.809605 2578 scope.go:117] "RemoveContainer" containerID="97bbbc613d08026249ce66a899461450594ce788b196c5b88e542f6c656cb55e" Sep 09 09:46:51.522241 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:46:51.522201 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:46:51.813008 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:46:51.812971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" event={"ID":"c60a532c-aae7-4f75-ae64-78312cc6048f","Type":"ContainerStarted","Data":"8d1791fc466eb981c635c7be0b9518b4ac025498e33118b85912990dce841c6a"} Sep 09 09:46:51.813363 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:46:51.813222 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:46:51.817001 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:46:51.814221 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7b45764b-sndpm" Sep 09 09:46:53.014031 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:46:53.014003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:10.905121 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:10.905091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:47:10.905595 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:10.905218 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 09:47:10.905595 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:10.905293 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs podName:d9f10052-2bb2-49e8-a943-46101a17508c nodeName:}" failed. No retries permitted until 2026-09-09 09:49:12.905277941 +0000 UTC m=+374.284311072 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs") pod "network-metrics-daemon-g26bw" (UID: "d9f10052-2bb2-49e8-a943-46101a17508c") : secret "metrics-daemon-secret" not found Sep 09 09:47:15.588353 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.588307 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r"] Sep 09 09:47:15.591223 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.591203 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b"] Sep 09 09:47:15.591338 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.591318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r" Sep 09 09:47:15.593833 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.593815 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cd4f4984d-2fqzd"] Sep 09 09:47:15.593952 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.593919 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 09 09:47:15.594023 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.593976 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.594079 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.594020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g2xmk\"" Sep 09 09:47:15.594273 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.594168 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 09 09:47:15.596459 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.596442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.597004 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.596984 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xp5xs\"" Sep 09 09:47:15.597102 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.597067 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 09 09:47:15.597102 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.597077 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 09 09:47:15.597215 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.597117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 09 09:47:15.597215 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.597067 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 09 09:47:15.600175 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.600159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 09 09:47:15.600400 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.600389 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 09 09:47:15.600751 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.600736 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 09:47:15.601653 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.601635 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 09 09:47:15.601833 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.601815 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 09 09:47:15.601927 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.601909 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fhzzc\"" Sep 09 09:47:15.602474 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.602452 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r"] Sep 09 09:47:15.604283 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.604265 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 09:47:15.609375 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.609357 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b"] Sep 09 09:47:15.611431 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.611409 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cd4f4984d-2fqzd"] Sep 09 09:47:15.635866 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.635841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-stats-auth\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.635965 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.635873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwjw2\" (UniqueName: \"kubernetes.io/projected/575ef0e1-b900-4149-9c9a-e58f5efece73-kube-api-access-jwjw2\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.635965 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.635890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.635965 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.635915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-default-certificate\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.636073 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.635977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575ef0e1-b900-4149-9c9a-e58f5efece73-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.636073 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.635995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.636073 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.636009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d82kt\" (UniqueName: \"kubernetes.io/projected/9bda6aec-fad4-467e-943f-8bf95be3784c-kube-api-access-d82kt\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.636169 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.636082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575ef0e1-b900-4149-9c9a-e58f5efece73-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.636169 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.636106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdpz7\" (UniqueName: \"kubernetes.io/projected/dc19dd90-391d-49f2-b55d-5730c9ce9382-kube-api-access-bdpz7\") pod \"volume-data-source-validator-695c895bd6-l7z6r\" (UID: \"dc19dd90-391d-49f2-b55d-5730c9ce9382\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r" Sep 09 09:47:15.681498 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.681468 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76d7d5bd4-lbmxs"] Sep 09 09:47:15.685126 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.685112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.687888 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.687869 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 09:47:15.687985 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.687944 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 09:47:15.688291 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.688275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 09:47:15.691837 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.691821 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rlksz\"" Sep 09 09:47:15.693368 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.693347 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 09:47:15.704436 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.704415 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76d7d5bd4-lbmxs"] Sep 09 09:47:15.736908 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.736881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-default-certificate\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.736991 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.736914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-installation-pull-secrets\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.736991 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.736935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-bound-sa-token\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.736991 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.736963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-image-registry-private-configuration\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.737102 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575ef0e1-b900-4149-9c9a-e58f5efece73-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.737102 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.737102 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d82kt\" (UniqueName: \"kubernetes.io/projected/9bda6aec-fad4-467e-943f-8bf95be3784c-kube-api-access-d82kt\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.737225 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/226c79ff-4983-4d5d-9109-c26fccc91d70-ca-trust-extracted\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.737225 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-certificates\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.737225 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575ef0e1-b900-4149-9c9a-e58f5efece73-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.737225 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdpz7\" (UniqueName: \"kubernetes.io/projected/dc19dd90-391d-49f2-b55d-5730c9ce9382-kube-api-access-bdpz7\") pod \"volume-data-source-validator-695c895bd6-l7z6r\" (UID: \"dc19dd90-391d-49f2-b55d-5730c9ce9382\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r" Sep 09 09:47:15.737479 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:15.737276 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 09:47:15.737479 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:15.737347 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:16.237328077 +0000 UTC m=+257.616361226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : secret "router-metrics-certs-default" not found Sep 09 09:47:15.737479 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.737479 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-trusted-ca\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.737479 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5d4b\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-kube-api-access-n5d4b\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.737762 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-stats-auth\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.737762 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwjw2\" (UniqueName: \"kubernetes.io/projected/575ef0e1-b900-4149-9c9a-e58f5efece73-kube-api-access-jwjw2\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.737762 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.737762 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:15.737693 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:16.237657009 +0000 UTC m=+257.616690161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : configmap references non-existent config key: service-ca.crt Sep 09 09:47:15.737762 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.737700 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575ef0e1-b900-4149-9c9a-e58f5efece73-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.739383 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.739362 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575ef0e1-b900-4149-9c9a-e58f5efece73-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.739576 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.739560 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-default-certificate\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.739779 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.739761 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-stats-auth\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.745645 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.745621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdpz7\" (UniqueName: \"kubernetes.io/projected/dc19dd90-391d-49f2-b55d-5730c9ce9382-kube-api-access-bdpz7\") pod \"volume-data-source-validator-695c895bd6-l7z6r\" (UID: \"dc19dd90-391d-49f2-b55d-5730c9ce9382\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r" Sep 09 09:47:15.745749 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.745641 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwjw2\" (UniqueName: \"kubernetes.io/projected/575ef0e1-b900-4149-9c9a-e58f5efece73-kube-api-access-jwjw2\") pod \"kube-storage-version-migrator-operator-8d7dd4675-4zj5b\" (UID: \"575ef0e1-b900-4149-9c9a-e58f5efece73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.745991 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.745974 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d82kt\" (UniqueName: \"kubernetes.io/projected/9bda6aec-fad4-467e-943f-8bf95be3784c-kube-api-access-d82kt\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:15.826712 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.826637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:15.838705 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.838662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-certificates\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.838773 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.838720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.838773 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.838736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-trusted-ca\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.838872 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:15.838816 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 09:47:15.838872 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:15.838832 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d7d5bd4-lbmxs: secret "image-registry-tls" not found Sep 09 09:47:15.838872 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.838849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5d4b\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-kube-api-access-n5d4b\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.839012 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:15.838893 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls podName:226c79ff-4983-4d5d-9109-c26fccc91d70 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:16.338876083 +0000 UTC m=+257.717909227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls") pod "image-registry-76d7d5bd4-lbmxs" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70") : secret "image-registry-tls" not found Sep 09 09:47:15.839012 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.838985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-installation-pull-secrets\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.839120 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.839013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-bound-sa-token\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.839120 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.839045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-image-registry-private-configuration\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.839217 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.839139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/226c79ff-4983-4d5d-9109-c26fccc91d70-ca-trust-extracted\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.839217 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.839164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-certificates\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.839436 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.839417 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/226c79ff-4983-4d5d-9109-c26fccc91d70-ca-trust-extracted\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.839506 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.839490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-trusted-ca\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.841302 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.841279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-installation-pull-secrets\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.841402 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.841385 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-image-registry-private-configuration\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.846960 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.846942 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5d4b\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-kube-api-access-n5d4b\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.847218 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.847198 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-bound-sa-token\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:15.901523 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.901493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r" Sep 09 09:47:15.910789 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.910481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" Sep 09 09:47:15.920378 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:15.920357 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:16.171897 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:16.171803 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r"] Sep 09 09:47:16.174773 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:16.174740 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc19dd90_391d_49f2_b55d_5730c9ce9382.slice/crio-58c3c5cbd884d9929bf4ace193fed711aadb68caccaa5d80726f13fc5227e186 WatchSource:0}: Error finding container 58c3c5cbd884d9929bf4ace193fed711aadb68caccaa5d80726f13fc5227e186: Status 404 returned error can't find the container with id 58c3c5cbd884d9929bf4ace193fed711aadb68caccaa5d80726f13fc5227e186 Sep 09 09:47:16.193155 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:16.193135 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b"] Sep 09 09:47:16.195831 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:16.195813 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575ef0e1_b900_4149_9c9a_e58f5efece73.slice/crio-9679c2dbc96ca0af0b475cc08ecd31046af7ce11ae7b2a1d785031bcf3eba88d WatchSource:0}: Error finding container 9679c2dbc96ca0af0b475cc08ecd31046af7ce11ae7b2a1d785031bcf3eba88d: Status 404 returned error can't find the container with id 9679c2dbc96ca0af0b475cc08ecd31046af7ce11ae7b2a1d785031bcf3eba88d Sep 09 09:47:16.241336 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:16.241312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:16.241429 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:16.241365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:16.241493 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:16.241466 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 09:47:16.241493 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:16.241477 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:17.241461383 +0000 UTC m=+258.620494521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : configmap references non-existent config key: service-ca.crt Sep 09 09:47:16.241589 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:16.241533 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:17.241513969 +0000 UTC m=+258.620547103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : secret "router-metrics-certs-default" not found Sep 09 09:47:16.342379 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:16.342347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:16.342527 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:16.342507 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 09:47:16.342596 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:16.342531 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d7d5bd4-lbmxs: secret "image-registry-tls" not found Sep 09 09:47:16.342596 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:16.342593 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls podName:226c79ff-4983-4d5d-9109-c26fccc91d70 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:17.342572092 +0000 UTC m=+258.721605229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls") pod "image-registry-76d7d5bd4-lbmxs" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70") : secret "image-registry-tls" not found Sep 09 09:47:16.876476 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:16.876444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" event={"ID":"575ef0e1-b900-4149-9c9a-e58f5efece73","Type":"ContainerStarted","Data":"9679c2dbc96ca0af0b475cc08ecd31046af7ce11ae7b2a1d785031bcf3eba88d"} Sep 09 09:47:16.878076 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:16.878013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r" event={"ID":"dc19dd90-391d-49f2-b55d-5730c9ce9382","Type":"ContainerStarted","Data":"58c3c5cbd884d9929bf4ace193fed711aadb68caccaa5d80726f13fc5227e186"} Sep 09 09:47:17.250110 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:17.250031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:17.250110 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:17.250096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:17.250302 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:17.250214 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 09:47:17.250302 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:17.250244 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:19.250226477 +0000 UTC m=+260.629259628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : configmap references non-existent config key: service-ca.crt Sep 09 09:47:17.250302 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:17.250282 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:19.250261204 +0000 UTC m=+260.629294353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : secret "router-metrics-certs-default" not found Sep 09 09:47:17.351073 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:17.351046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:17.351188 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:17.351174 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 09:47:17.351274 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:17.351191 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d7d5bd4-lbmxs: secret "image-registry-tls" not found Sep 09 09:47:17.351274 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:17.351244 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls podName:226c79ff-4983-4d5d-9109-c26fccc91d70 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:19.35122719 +0000 UTC m=+260.730260328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls") pod "image-registry-76d7d5bd4-lbmxs" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70") : secret "image-registry-tls" not found Sep 09 09:47:17.882971 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:17.882931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r" event={"ID":"dc19dd90-391d-49f2-b55d-5730c9ce9382","Type":"ContainerStarted","Data":"1e552287452a806c5dc53fe065a31f7cde2aa82f574b557cb556f79c4997ad9a"} Sep 09 09:47:17.898909 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:17.898845 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-l7z6r" podStartSLOduration=1.7919829269999998 podStartE2EDuration="2.898824287s" totalImagesPullingTime="1.10684136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:17.898382835 +0000 UTC m=+259.277416010" watchObservedRunningTime="2026-09-09 09:47:17.898824287 +0000 UTC m=+259.277857445" Sep 09 09:47:17.981042 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:17.980989 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:18.033286 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:18.033245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:18.888293 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:18.888261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" event={"ID":"575ef0e1-b900-4149-9c9a-e58f5efece73","Type":"ContainerStarted","Data":"c2c76b8d8b544e7247bafdd98680296024b0cc6a7b88cbbceb8c1a6318873201"} Sep 09 09:47:18.906656 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:18.906615 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" podStartSLOduration=1.753932522 podStartE2EDuration="3.90660217s" totalImagesPullingTime="2.152669648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:18.905498571 +0000 UTC m=+260.284531724" watchObservedRunningTime="2026-09-09 09:47:18.90660217 +0000 UTC m=+260.285635325" Sep 09 09:47:19.267343 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:19.267264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:19.267343 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:19.267331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:19.267547 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:19.267408 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 09:47:19.267547 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:19.267470 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:23.267452528 +0000 UTC m=+264.646485675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : configmap references non-existent config key: service-ca.crt Sep 09 09:47:19.267547 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:19.267486 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:23.267479519 +0000 UTC m=+264.646512652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : secret "router-metrics-certs-default" not found Sep 09 09:47:19.368342 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:19.368311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:19.368486 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:19.368435 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 09:47:19.368486 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:19.368447 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d7d5bd4-lbmxs: secret "image-registry-tls" not found Sep 09 09:47:19.368561 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:19.368505 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls podName:226c79ff-4983-4d5d-9109-c26fccc91d70 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:23.368492124 +0000 UTC m=+264.747525257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls") pod "image-registry-76d7d5bd4-lbmxs" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70") : secret "image-registry-tls" not found Sep 09 09:47:19.533617 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:19.533539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:19.624548 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:19.624517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:19.725338 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:19.725311 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:20.327694 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.327653 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2msmf"] Sep 09 09:47:20.330876 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.330853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.333542 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.333521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dznl6\"" Sep 09 09:47:20.333663 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.333567 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 09:47:20.334505 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.334478 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 09:47:20.334606 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.334525 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 09:47:20.334606 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.334552 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 09:47:20.341102 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.341083 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2msmf"] Sep 09 09:47:20.348939 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.348919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:20.375775 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.375756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.375890 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.375784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.375890 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.375820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-data-volume\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.376005 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.375952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8pbc\" (UniqueName: \"kubernetes.io/projected/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-api-access-s8pbc\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.376058 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.376015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-crio-socket\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.406964 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.406906 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:20.477235 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.477215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-crio-socket\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.477316 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.477269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.477316 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.477287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.477428 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.477323 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-crio-socket\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.477428 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:20.477356 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:20.477428 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:20.477368 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:20.477428 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:20.477404 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:20.977393105 +0000 UTC m=+262.356426236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:20.477428 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:20.477423 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:20.977413134 +0000 UTC m=+262.356446318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : configmap "kube-rbac-proxy" not found Sep 09 09:47:20.477671 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.477439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-data-volume\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.477671 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.477521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8pbc\" (UniqueName: \"kubernetes.io/projected/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-api-access-s8pbc\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.477819 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.477737 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-data-volume\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.485167 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.485144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8pbc\" (UniqueName: \"kubernetes.io/projected/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-api-access-s8pbc\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.601372 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.601317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:20.665087 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.665058 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:20.800750 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.800724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:20.858652 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.858592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:20.981988 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.981952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.981988 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:20.981991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:20.982185 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:20.982082 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:20.982185 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:20.982109 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:20.982185 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:20.982163 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:21.98214257 +0000 UTC m=+263.361175719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : configmap "kube-rbac-proxy" not found Sep 09 09:47:20.982185 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:20.982184 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:21.982172478 +0000 UTC m=+263.361205615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:21.274462 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:21.274389 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:21.375365 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:21.375337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:21.895759 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:21.895726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:21.990467 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:21.990436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:21.990581 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:21.990469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:21.990646 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:21.990572 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:21.990646 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:21.990603 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:21.990646 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:21.990644 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:23.990625684 +0000 UTC m=+265.369658821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : configmap "kube-rbac-proxy" not found Sep 09 09:47:21.990795 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:21.990660 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:23.990653518 +0000 UTC m=+265.369686649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:21.997950 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:21.997925 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:22.914556 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:22.914523 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:23.015175 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:23.015149 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:23.297776 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:23.297696 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s8b84_7368ba37-5e70-4a5b-b7dc-b7b825f0506a/dns-node-resolver/0.log" Sep 09 09:47:23.298871 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:23.298852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:23.298944 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:23.298920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:23.299024 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:23.299007 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 09:47:23.299071 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:23.299049 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:31.299031475 +0000 UTC m=+272.678064821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : configmap references non-existent config key: service-ca.crt Sep 09 09:47:23.299123 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:23.299071 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs podName:9bda6aec-fad4-467e-943f-8bf95be3784c nodeName:}" failed. No retries permitted until 2026-09-09 09:47:31.299064735 +0000 UTC m=+272.678097868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs") pod "router-default-7cd4f4984d-2fqzd" (UID: "9bda6aec-fad4-467e-943f-8bf95be3784c") : secret "router-metrics-certs-default" not found Sep 09 09:47:23.400168 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:23.400142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:23.400349 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:23.400287 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 09:47:23.400349 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:23.400302 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76d7d5bd4-lbmxs: secret "image-registry-tls" not found Sep 09 09:47:23.400418 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:23.400365 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls podName:226c79ff-4983-4d5d-9109-c26fccc91d70 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:31.400348887 +0000 UTC m=+272.779382036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls") pod "image-registry-76d7d5bd4-lbmxs" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70") : secret "image-registry-tls" not found Sep 09 09:47:23.983092 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:23.983058 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:24.006207 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:24.006184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:24.006335 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:24.006214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:24.006335 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:24.006295 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:24.006335 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:24.006299 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:24.006434 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:24.006356 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:28.006344101 +0000 UTC m=+269.385377233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:24.006434 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:24.006368 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:28.006362532 +0000 UTC m=+269.385395665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : configmap "kube-rbac-proxy" not found Sep 09 09:47:24.298076 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:24.298004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vxccb_269a7999-e486-4a0f-bfc5-4bc9265dbbb1/node-ca/0.log" Sep 09 09:47:24.712040 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:24.712004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:24.813922 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:24.813890 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:24.897593 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:24.897569 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r55m5_4dc29d55-4502-44b6-b15e-13bca7c9e4e0/serve-healthcheck-canary/0.log" Sep 09 09:47:24.912653 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:24.912628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:25.021914 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:25.021836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:25.113789 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:25.113762 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:25.228320 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:25.228290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:25.410309 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:25.410282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:25.698830 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:25.698765 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-4zj5b_575ef0e1-b900-4149-9c9a-e58f5efece73/kube-storage-version-migrator-operator/0.log" Sep 09 09:47:26.416081 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:26.416046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:26.616882 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:26.616849 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:26.840787 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:26.840755 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:27.010197 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:27.010159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:27.210003 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:27.209925 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:27.813981 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:27.813948 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:28.006758 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:28.006727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:28.035827 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:28.035797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:28.035901 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:28.035834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:28.035938 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:28.035916 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:28.035967 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:28.035957 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:28.035998 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:28.035987 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:36.035969619 +0000 UTC m=+277.415002771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : configmap "kube-rbac-proxy" not found Sep 09 09:47:28.036035 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:28.036001 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls podName:cf9a2eee-bf5e-495a-9cd5-8fc8902a0310 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:36.035995348 +0000 UTC m=+277.415028480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2msmf" (UID: "cf9a2eee-bf5e-495a-9cd5-8fc8902a0310") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:28.389353 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:28.389321 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:28.542296 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:28.542270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:28.643597 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:28.643531 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:29.007002 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:29.006931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:29.407224 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:29.407196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:29.618538 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:29.618499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:30.007383 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:30.007344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:30.398164 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:30.398134 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:30.614858 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:30.614820 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:31.011351 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.011322 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:31.201993 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.201968 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:31.363167 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.363135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:31.363325 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.363197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:31.363740 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.363722 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bda6aec-fad4-467e-943f-8bf95be3784c-service-ca-bundle\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:31.365573 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.365553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bda6aec-fad4-467e-943f-8bf95be3784c-metrics-certs\") pod \"router-default-7cd4f4984d-2fqzd\" (UID: \"9bda6aec-fad4-467e-943f-8bf95be3784c\") " pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:31.406835 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.406807 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:31.463981 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.463959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:31.466298 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.466276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"image-registry-76d7d5bd4-lbmxs\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:31.515360 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.515335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:31.593207 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.593185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:31.612508 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.612483 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:31.786971 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.786949 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cd4f4984d-2fqzd"] Sep 09 09:47:31.789147 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:31.789122 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bda6aec_fad4_467e_943f_8bf95be3784c.slice/crio-2e8fee4d225384dceae6ef7948d8c005680fbe81b97c33ccbc593b2cb20bf16a WatchSource:0}: Error finding container 2e8fee4d225384dceae6ef7948d8c005680fbe81b97c33ccbc593b2cb20bf16a: Status 404 returned error can't find the container with id 2e8fee4d225384dceae6ef7948d8c005680fbe81b97c33ccbc593b2cb20bf16a Sep 09 09:47:31.865599 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.865578 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76d7d5bd4-lbmxs"] Sep 09 09:47:31.868004 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:31.867978 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226c79ff_4983_4d5d_9109_c26fccc91d70.slice/crio-76379ab61851cc950f5911e3638fd847679a2f5b7743a75f0caa7973934a6e0f WatchSource:0}: Error finding container 76379ab61851cc950f5911e3638fd847679a2f5b7743a75f0caa7973934a6e0f: Status 404 returned error can't find the container with id 76379ab61851cc950f5911e3638fd847679a2f5b7743a75f0caa7973934a6e0f Sep 09 09:47:31.929750 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.929716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" event={"ID":"226c79ff-4983-4d5d-9109-c26fccc91d70","Type":"ContainerStarted","Data":"76379ab61851cc950f5911e3638fd847679a2f5b7743a75f0caa7973934a6e0f"} Sep 09 09:47:31.931223 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.931197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" event={"ID":"9bda6aec-fad4-467e-943f-8bf95be3784c","Type":"ContainerStarted","Data":"1501b5b41f45fa61207271b84cb518ca7b6420b975e708bbf2e0f99dda25a268"} Sep 09 09:47:31.931310 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.931240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" event={"ID":"9bda6aec-fad4-467e-943f-8bf95be3784c","Type":"ContainerStarted","Data":"2e8fee4d225384dceae6ef7948d8c005680fbe81b97c33ccbc593b2cb20bf16a"} Sep 09 09:47:31.948659 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:31.948548 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" podStartSLOduration=16.948529334 podStartE2EDuration="16.948529334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:31.947848581 +0000 UTC m=+273.326881746" watchObservedRunningTime="2026-09-09 09:47:31.948529334 +0000 UTC m=+273.327562488" Sep 09 09:47:32.009124 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:32.009096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:32.515779 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:32.515741 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:32.518210 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:32.518187 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:32.787367 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:32.787290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:32.935647 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:32.935616 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" event={"ID":"226c79ff-4983-4d5d-9109-c26fccc91d70","Type":"ContainerStarted","Data":"4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee"} Sep 09 09:47:32.935901 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:32.935880 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:32.936976 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:32.936958 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cd4f4984d-2fqzd" Sep 09 09:47:32.954476 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:32.954434 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" podStartSLOduration=17.954417346 podStartE2EDuration="17.954417346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:32.953718622 +0000 UTC m=+274.332751796" watchObservedRunningTime="2026-09-09 09:47:32.954417346 +0000 UTC m=+274.333450500" Sep 09 09:47:33.938813 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:33.938785 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:34.444822 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:34.444791 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:34.633799 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:34.633771 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:35.010097 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:35.010058 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:35.206618 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:35.206592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:35.406845 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:35.406814 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:36.102018 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:36.101981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:36.102018 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:36.102022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:36.102495 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:36.102474 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:36.104500 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:36.104478 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf9a2eee-bf5e-495a-9cd5-8fc8902a0310-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2msmf\" (UID: \"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310\") " pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:36.240128 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:36.240105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2msmf" Sep 09 09:47:36.518381 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:36.518309 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2msmf"] Sep 09 09:47:36.521188 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:36.521160 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9a2eee_bf5e_495a_9cd5_8fc8902a0310.slice/crio-93741d6347f9c0d11a99509084a452bc816595ec3e1fc6229bbd872f76f9b56f WatchSource:0}: Error finding container 93741d6347f9c0d11a99509084a452bc816595ec3e1fc6229bbd872f76f9b56f: Status 404 returned error can't find the container with id 93741d6347f9c0d11a99509084a452bc816595ec3e1fc6229bbd872f76f9b56f Sep 09 09:47:36.949428 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:36.949397 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2msmf" event={"ID":"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310","Type":"ContainerStarted","Data":"b891ac6d5cc18866f1859d2681072e7741ce71d29362c46b11890f37e59638c4"} Sep 09 09:47:36.949575 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:36.949450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2msmf" event={"ID":"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310","Type":"ContainerStarted","Data":"93741d6347f9c0d11a99509084a452bc816595ec3e1fc6229bbd872f76f9b56f"} Sep 09 09:47:37.954663 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:37.954632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2msmf" event={"ID":"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310","Type":"ContainerStarted","Data":"ba5e98010a7b81001646a870fd22e977a1ecb34a3b3c85037ec0f19da180768e"} Sep 09 09:47:39.630636 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:39.630584 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wgslx" podUID="4548e955-dc4a-4933-a001-59047b181ea1" Sep 09 09:47:39.963258 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:39.963180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgslx" Sep 09 09:47:39.963258 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:39.963214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2msmf" event={"ID":"cf9a2eee-bf5e-495a-9cd5-8fc8902a0310","Type":"ContainerStarted","Data":"70cc0abc73223260259656d07b0ddbc59c9105ab9c04190bf7cd4578868a0556"} Sep 09 09:47:39.982309 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:39.982265 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2msmf" podStartSLOduration=17.704444931 podStartE2EDuration="19.982251478s" totalImagesPullingTime="2.277806547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:47:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:39.981071022 +0000 UTC m=+281.360104192" watchObservedRunningTime="2026-09-09 09:47:39.982251478 +0000 UTC m=+281.361284632" Sep 09 09:47:41.183091 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:41.183057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:41.284933 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:41.284896 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:42.845760 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:42.845727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:47:42.848206 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:42.848184 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4548e955-dc4a-4933-a001-59047b181ea1-metrics-tls\") pod \"dns-default-wgslx\" (UID: \"4548e955-dc4a-4933-a001-59047b181ea1\") " pod="openshift-dns/dns-default-wgslx" Sep 09 09:47:42.966847 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:42.966818 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25h6q\"" Sep 09 09:47:42.975091 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:42.975069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgslx" Sep 09 09:47:43.243845 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:43.243774 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wgslx"] Sep 09 09:47:43.246613 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:43.246587 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4548e955_dc4a_4933_a001_59047b181ea1.slice/crio-61949d3fe478f0c295dae1b36379b58a53d7261dbabe3d56dd643bd614019bc6 WatchSource:0}: Error finding container 61949d3fe478f0c295dae1b36379b58a53d7261dbabe3d56dd643bd614019bc6: Status 404 returned error can't find the container with id 61949d3fe478f0c295dae1b36379b58a53d7261dbabe3d56dd643bd614019bc6 Sep 09 09:47:43.977600 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:43.977565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgslx" event={"ID":"4548e955-dc4a-4933-a001-59047b181ea1","Type":"ContainerStarted","Data":"61949d3fe478f0c295dae1b36379b58a53d7261dbabe3d56dd643bd614019bc6"} Sep 09 09:47:44.482966 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:44.482897 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:44.581971 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:44.581940 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:44.639040 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:44.639011 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:44.790209 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:44.790181 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:44.983961 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:44.983930 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgslx" event={"ID":"4548e955-dc4a-4933-a001-59047b181ea1","Type":"ContainerStarted","Data":"b531eb7c12f530533755e380bade674d3719faf629553d2d38019d2e965c123b"} Sep 09 09:47:44.984302 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:44.983996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgslx" event={"ID":"4548e955-dc4a-4933-a001-59047b181ea1","Type":"ContainerStarted","Data":"1025c121e1eeac4daf636a10e800cc2c282b811d34c5394fc7e2da4ac6f6e5dc"} Sep 09 09:47:44.984302 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:44.984028 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wgslx" Sep 09 09:47:45.003174 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.003135 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wgslx" podStartSLOduration=251.468577565 podStartE2EDuration="4m13.003120795s" totalImagesPullingTime="1.53454323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:45.002411192 +0000 UTC m=+286.381444346" watchObservedRunningTime="2026-09-09 09:47:45.003120795 +0000 UTC m=+286.382153949" Sep 09 09:47:45.162791 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.162768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:45.235804 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.235768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:45.429090 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.429063 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76d7d5bd4-lbmxs"] Sep 09 09:47:45.467372 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.467344 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-685bc57656-7d9nz"] Sep 09 09:47:45.470346 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.470324 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.484447 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.484429 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-685bc57656-7d9nz"] Sep 09 09:47:45.546767 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.546745 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:45.563557 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.563534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6b944e0-a241-4983-931e-1a5ea3bf98bc-trusted-ca\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.563646 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.563562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6b944e0-a241-4983-931e-1a5ea3bf98bc-image-registry-private-configuration\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.563646 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.563579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6b944e0-a241-4983-931e-1a5ea3bf98bc-registry-certificates\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.563646 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.563617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6b944e0-a241-4983-931e-1a5ea3bf98bc-ca-trust-extracted\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.563646 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.563631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhlkq\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-kube-api-access-vhlkq\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.563837 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.563648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-bound-sa-token\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.563837 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.563663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-registry-tls\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.563837 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.563779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6b944e0-a241-4983-931e-1a5ea3bf98bc-installation-pull-secrets\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.643945 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.643921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:45.664857 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.664836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6b944e0-a241-4983-931e-1a5ea3bf98bc-trusted-ca\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.664930 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.664864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6b944e0-a241-4983-931e-1a5ea3bf98bc-image-registry-private-configuration\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.664930 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.664880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6b944e0-a241-4983-931e-1a5ea3bf98bc-registry-certificates\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.665060 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.665040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6b944e0-a241-4983-931e-1a5ea3bf98bc-ca-trust-extracted\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.665124 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.665074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhlkq\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-kube-api-access-vhlkq\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.665124 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.665107 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-bound-sa-token\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.665218 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.665132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-registry-tls\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.665218 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.665182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6b944e0-a241-4983-931e-1a5ea3bf98bc-installation-pull-secrets\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.665819 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.665759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6b944e0-a241-4983-931e-1a5ea3bf98bc-registry-certificates\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.665819 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.665782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6b944e0-a241-4983-931e-1a5ea3bf98bc-ca-trust-extracted\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.666068 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.666044 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6b944e0-a241-4983-931e-1a5ea3bf98bc-trusted-ca\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.667373 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.667317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6b944e0-a241-4983-931e-1a5ea3bf98bc-image-registry-private-configuration\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.667493 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.667476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6b944e0-a241-4983-931e-1a5ea3bf98bc-installation-pull-secrets\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.667711 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.667671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-registry-tls\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.674202 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.674177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-bound-sa-token\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.674837 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.674821 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhlkq\" (UniqueName: \"kubernetes.io/projected/e6b944e0-a241-4983-931e-1a5ea3bf98bc-kube-api-access-vhlkq\") pod \"image-registry-685bc57656-7d9nz\" (UID: \"e6b944e0-a241-4983-931e-1a5ea3bf98bc\") " pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.745987 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.745964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:45.778467 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.778441 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:45.846387 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.846362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:45.910122 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.910100 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:45.972207 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:45.972145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:46.051422 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:46.051399 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-685bc57656-7d9nz"] Sep 09 09:47:46.054301 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:46.054280 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b944e0_a241_4983_931e_1a5ea3bf98bc.slice/crio-27507bf83abd20fb829e4c3eb7cc93531c1e2aacae2339c8df7f7726b69ec3bd WatchSource:0}: Error finding container 27507bf83abd20fb829e4c3eb7cc93531c1e2aacae2339c8df7f7726b69ec3bd: Status 404 returned error can't find the container with id 27507bf83abd20fb829e4c3eb7cc93531c1e2aacae2339c8df7f7726b69ec3bd Sep 09 09:47:46.170937 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:46.170890 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:46.242440 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:46.242369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:46.991939 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:46.991903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685bc57656-7d9nz" event={"ID":"e6b944e0-a241-4983-931e-1a5ea3bf98bc","Type":"ContainerStarted","Data":"280da92268d5a01112d02b0a42ad5876df24039428c6d4c5ea34e93411488446"} Sep 09 09:47:46.992109 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:46.991956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-685bc57656-7d9nz" event={"ID":"e6b944e0-a241-4983-931e-1a5ea3bf98bc","Type":"ContainerStarted","Data":"27507bf83abd20fb829e4c3eb7cc93531c1e2aacae2339c8df7f7726b69ec3bd"} Sep 09 09:47:46.992109 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:46.992026 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:47:47.011428 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:47.011370 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-685bc57656-7d9nz" podStartSLOduration=2.01135317 podStartE2EDuration="2.01135317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:47.010235119 +0000 UTC m=+288.389268273" watchObservedRunningTime="2026-09-09 09:47:47.01135317 +0000 UTC m=+288.390386325" Sep 09 09:47:47.804132 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:47.804106 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:50.115996 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:50.115962 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:50.214777 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:50.214747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:50.671871 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:50.671837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:50.781863 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:50.781836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:52.126268 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:52.126214 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g26bw" podUID="d9f10052-2bb2-49e8-a943-46101a17508c" Sep 09 09:47:54.334327 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.334297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:54.360407 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.360379 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-sztkt"] Sep 09 09:47:54.365145 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.365128 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.368457 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.368432 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 09 09:47:54.368584 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.368477 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 09:47:54.368584 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.368494 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 09:47:54.368584 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.368516 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 09 09:47:54.368584 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.368485 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 09:47:54.368584 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.368479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j2cd9\"" Sep 09 09:47:54.372201 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.372181 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-sztkt"] Sep 09 09:47:54.399327 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.399303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:54.527230 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.527206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj4mz\" (UniqueName: \"kubernetes.io/projected/22da5b42-96de-4b37-b505-e6316332006e-kube-api-access-bj4mz\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.527340 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.527269 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22da5b42-96de-4b37-b505-e6316332006e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.527340 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.527288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.527340 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.527320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.628603 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.628533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22da5b42-96de-4b37-b505-e6316332006e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.628603 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.628579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.628732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.628628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.628732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.628654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj4mz\" (UniqueName: \"kubernetes.io/projected/22da5b42-96de-4b37-b505-e6316332006e-kube-api-access-bj4mz\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.628854 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:54.628749 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 09 09:47:54.628854 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:54.628817 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-tls podName:22da5b42-96de-4b37-b505-e6316332006e nodeName:}" failed. No retries permitted until 2026-09-09 09:47:55.128801556 +0000 UTC m=+296.507834688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-sztkt" (UID: "22da5b42-96de-4b37-b505-e6316332006e") : secret "prometheus-operator-tls" not found Sep 09 09:47:54.629262 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.629235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22da5b42-96de-4b37-b505-e6316332006e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.631088 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.631072 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.637294 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.637274 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj4mz\" (UniqueName: \"kubernetes.io/projected/22da5b42-96de-4b37-b505-e6316332006e-kube-api-access-bj4mz\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:54.988619 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:54.988550 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wgslx" Sep 09 09:47:55.131856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:55.131814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:55.134105 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:55.134077 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22da5b42-96de-4b37-b505-e6316332006e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-sztkt\" (UID: \"22da5b42-96de-4b37-b505-e6316332006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:55.138097 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:55.138072 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:55.275272 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:55.275214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" Sep 09 09:47:55.434738 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:55.434715 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:47:55.541021 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:55.540956 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-sztkt"] Sep 09 09:47:55.543777 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:55.543745 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22da5b42_96de_4b37_b505_e6316332006e.slice/crio-3cd89e6c39e237a0036f844a422626c1057e5c7400d3582e0466525b7d6babb6 WatchSource:0}: Error finding container 3cd89e6c39e237a0036f844a422626c1057e5c7400d3582e0466525b7d6babb6: Status 404 returned error can't find the container with id 3cd89e6c39e237a0036f844a422626c1057e5c7400d3582e0466525b7d6babb6 Sep 09 09:47:56.020467 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:56.020437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" event={"ID":"22da5b42-96de-4b37-b505-e6316332006e","Type":"ContainerStarted","Data":"3cd89e6c39e237a0036f844a422626c1057e5c7400d3582e0466525b7d6babb6"} Sep 09 09:47:56.391045 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:56.391018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:56.458805 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:56.458778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:57.001987 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:57.001963 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:57.030643 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:57.030604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" event={"ID":"22da5b42-96de-4b37-b505-e6316332006e","Type":"ContainerStarted","Data":"3cb3f0ddd3789391ba63a4a349588b2c6840f02b24767079daee362817427ba1"} Sep 09 09:47:57.030836 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:57.030699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" event={"ID":"22da5b42-96de-4b37-b505-e6316332006e","Type":"ContainerStarted","Data":"6213355c424022f475965317cdcc5fc538aabef3586095f0e871e7084b3d8681"} Sep 09 09:47:57.050788 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:57.050745 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-sztkt" podStartSLOduration=1.724197164 podStartE2EDuration="3.050733012s" totalImagesPullingTime="1.326535848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:57.049635219 +0000 UTC m=+298.428668393" watchObservedRunningTime="2026-09-09 09:47:57.050733012 +0000 UTC m=+298.429766166" Sep 09 09:47:57.102042 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:57.102001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:57.203302 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:57.203222 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:58.458280 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.458239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:58.665338 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.665310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:58.712669 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.712608 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dkmdw"] Sep 09 09:47:58.715730 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.715706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.720192 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.720170 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 09:47:58.720288 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.720238 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 09:47:58.720419 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.720404 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2rn2r\"" Sep 09 09:47:58.720472 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.720451 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 09:47:58.755789 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.755765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:58.860310 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccb47908-7d88-4839-9b60-e75aeeeef7c5-metrics-client-ca\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.860409 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.860409 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-root\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.860479 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-wtmp\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.860479 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-sys\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.860479 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-tls\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.860566 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqz2s\" (UniqueName: \"kubernetes.io/projected/ccb47908-7d88-4839-9b60-e75aeeeef7c5-kube-api-access-xqz2s\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.860566 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-textfile\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.860566 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.860537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.954708 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.954664 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:58.961841 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.961823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-sys\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.961909 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.961850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-tls\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.961909 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.961887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqz2s\" (UniqueName: \"kubernetes.io/projected/ccb47908-7d88-4839-9b60-e75aeeeef7c5-kube-api-access-xqz2s\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.961977 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.961913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-textfile\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.961977 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.961922 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-sys\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.961977 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.961933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.961977 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:58.961968 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 09:47:58.962103 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:47:58.962022 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-tls podName:ccb47908-7d88-4839-9b60-e75aeeeef7c5 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:59.462008446 +0000 UTC m=+300.841041578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-tls") pod "node-exporter-dkmdw" (UID: "ccb47908-7d88-4839-9b60-e75aeeeef7c5") : secret "node-exporter-tls" not found Sep 09 09:47:58.962103 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccb47908-7d88-4839-9b60-e75aeeeef7c5-metrics-client-ca\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.962208 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.962208 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-root\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.962208 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-wtmp\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.962355 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-root\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.962355 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962288 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-textfile\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.962355 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962308 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-wtmp\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.962631 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962611 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccb47908-7d88-4839-9b60-e75aeeeef7c5-metrics-client-ca\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.962732 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.962644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.964198 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.964179 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:58.970518 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:58.970497 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqz2s\" (UniqueName: \"kubernetes.io/projected/ccb47908-7d88-4839-9b60-e75aeeeef7c5-kube-api-access-xqz2s\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:59.046542 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.046524 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 09:47:59.054596 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.054569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:59.189381 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.189270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:59.285044 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.284992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:59.465794 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.465766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-tls\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:59.468046 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.468025 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ccb47908-7d88-4839-9b60-e75aeeeef7c5-node-exporter-tls\") pod \"node-exporter-dkmdw\" (UID: \"ccb47908-7d88-4839-9b60-e75aeeeef7c5\") " pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:59.626239 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.626215 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2rn2r\"" Sep 09 09:47:59.634985 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.634967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dkmdw" Sep 09 09:47:59.645712 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:47:59.645659 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb47908_7d88_4839_9b60_e75aeeeef7c5.slice/crio-249834f3ad37caf1ae5ab1a72cc7967b5b37a9743a00f0bae6b3ad33b2781748 WatchSource:0}: Error finding container 249834f3ad37caf1ae5ab1a72cc7967b5b37a9743a00f0bae6b3ad33b2781748: Status 404 returned error can't find the container with id 249834f3ad37caf1ae5ab1a72cc7967b5b37a9743a00f0bae6b3ad33b2781748 Sep 09 09:47:59.680746 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.680727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:59.754088 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.754059 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:59.881406 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.881333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:47:59.981582 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:47:59.981550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:00.040500 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:00.040468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dkmdw" event={"ID":"ccb47908-7d88-4839-9b60-e75aeeeef7c5","Type":"ContainerStarted","Data":"249834f3ad37caf1ae5ab1a72cc7967b5b37a9743a00f0bae6b3ad33b2781748"} Sep 09 09:48:00.082640 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:00.082613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:01.526127 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:01.526096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:01.627077 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:01.627055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:01.726834 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:01.726800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:01.826836 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:01.826804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:01.990800 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:01.990767 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:02.049384 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:02.049347 2578 generic.go:356] "Generic (PLEG): container finished" podID="ccb47908-7d88-4839-9b60-e75aeeeef7c5" containerID="9daeec5182fd7a9dffd5000b134c87a1518a1bf1baec853142513f59a1af398d" exitCode=0 Sep 09 09:48:02.049559 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:02.049422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dkmdw" event={"ID":"ccb47908-7d88-4839-9b60-e75aeeeef7c5","Type":"ContainerDied","Data":"9daeec5182fd7a9dffd5000b134c87a1518a1bf1baec853142513f59a1af398d"} Sep 09 09:48:02.443066 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:02.442991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:02.545123 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:02.545097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:03.055162 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.055129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dkmdw" event={"ID":"ccb47908-7d88-4839-9b60-e75aeeeef7c5","Type":"ContainerStarted","Data":"bd3211111a017ea116d402cefeaf2b94d393869f650fee62b87df64730bb556c"} Sep 09 09:48:03.055315 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.055186 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dkmdw" event={"ID":"ccb47908-7d88-4839-9b60-e75aeeeef7c5","Type":"ContainerStarted","Data":"5fdb6f6059945c2ddf3f0b2d05acf6c066ba6641b604dbdb76a3f96d94ad8dd2"} Sep 09 09:48:03.077859 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.077806 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dkmdw" podStartSLOduration=3.618094344 podStartE2EDuration="5.077789432s" totalImagesPullingTime="1.38904479s" totalInitContainerRuntime="70.650298ms" isStatefulPod=true podCreationTimestamp="2026-09-09 09:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:03.075752206 +0000 UTC m=+304.454785376" watchObservedRunningTime="2026-09-09 09:48:03.077789432 +0000 UTC m=+304.456822585" Sep 09 09:48:03.079890 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.079859 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-848656fc4c-jh4pw"] Sep 09 09:48:03.082921 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.082902 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.085616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.085585 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 09:48:03.085616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.085607 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a8jacf4t7gmdg\"" Sep 09 09:48:03.085793 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.085610 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 09:48:03.085793 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.085611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 09:48:03.085793 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.085754 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-22jbc\"" Sep 09 09:48:03.086016 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.086003 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 09:48:03.091782 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.091759 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-848656fc4c-jh4pw"] Sep 09 09:48:03.196842 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.196818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-secret-metrics-server-tls\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.196944 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.196868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/599fb9ac-8161-437b-a818-f0f4deb56b80-metrics-server-audit-profiles\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.196997 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.196969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/599fb9ac-8161-437b-a818-f0f4deb56b80-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.197034 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.197011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fdkb\" (UniqueName: \"kubernetes.io/projected/599fb9ac-8161-437b-a818-f0f4deb56b80-kube-api-access-4fdkb\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.197077 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.197050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-client-ca-bundle\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.197115 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.197093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/599fb9ac-8161-437b-a818-f0f4deb56b80-audit-log\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.197170 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.197115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-secret-metrics-server-client-certs\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.297688 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.297651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/599fb9ac-8161-437b-a818-f0f4deb56b80-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.297793 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.297709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fdkb\" (UniqueName: \"kubernetes.io/projected/599fb9ac-8161-437b-a818-f0f4deb56b80-kube-api-access-4fdkb\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.297793 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.297747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-client-ca-bundle\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.297793 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.297776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/599fb9ac-8161-437b-a818-f0f4deb56b80-audit-log\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.297945 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.297804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-secret-metrics-server-client-certs\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.297945 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.297931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-secret-metrics-server-tls\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.298045 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.297978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/599fb9ac-8161-437b-a818-f0f4deb56b80-metrics-server-audit-profiles\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.298125 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.298107 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/599fb9ac-8161-437b-a818-f0f4deb56b80-audit-log\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.298435 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.298399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/599fb9ac-8161-437b-a818-f0f4deb56b80-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.298826 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.298806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/599fb9ac-8161-437b-a818-f0f4deb56b80-metrics-server-audit-profiles\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.300385 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.300363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-secret-metrics-server-tls\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.300464 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.300443 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-secret-metrics-server-client-certs\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.300605 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.300584 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/599fb9ac-8161-437b-a818-f0f4deb56b80-client-ca-bundle\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.307145 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.307090 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fdkb\" (UniqueName: \"kubernetes.io/projected/599fb9ac-8161-437b-a818-f0f4deb56b80-kube-api-access-4fdkb\") pod \"metrics-server-848656fc4c-jh4pw\" (UID: \"599fb9ac-8161-437b-a818-f0f4deb56b80\") " pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.392911 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.392883 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:03.475206 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.475171 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:03.487372 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.487345 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq"] Sep 09 09:48:03.491521 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.491501 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:03.493963 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.493938 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 09 09:48:03.494177 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.494161 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qpk9m\"" Sep 09 09:48:03.500131 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.500098 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq"] Sep 09 09:48:03.573653 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.573591 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:03.600645 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.600621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eb9836da-175a-4bbc-b49d-a7d5e26e7666-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-c9swq\" (UID: \"eb9836da-175a-4bbc-b49d-a7d5e26e7666\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:03.600754 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.600654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4fqt\" (UniqueName: \"kubernetes.io/projected/eb9836da-175a-4bbc-b49d-a7d5e26e7666-kube-api-access-f4fqt\") pod \"monitoring-plugin-85bbbbbf4-c9swq\" (UID: \"eb9836da-175a-4bbc-b49d-a7d5e26e7666\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:03.674240 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.674210 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:03.681543 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.681520 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-848656fc4c-jh4pw"] Sep 09 09:48:03.684060 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:48:03.684040 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599fb9ac_8161_437b_a818_f0f4deb56b80.slice/crio-13416eebfe73e40b40d764e5de606249ba7e4191ce0abe4b3b93bab8dec3cb20 WatchSource:0}: Error finding container 13416eebfe73e40b40d764e5de606249ba7e4191ce0abe4b3b93bab8dec3cb20: Status 404 returned error can't find the container with id 13416eebfe73e40b40d764e5de606249ba7e4191ce0abe4b3b93bab8dec3cb20 Sep 09 09:48:03.686427 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.686413 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 09:48:03.701365 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.701340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eb9836da-175a-4bbc-b49d-a7d5e26e7666-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-c9swq\" (UID: \"eb9836da-175a-4bbc-b49d-a7d5e26e7666\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:03.701469 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.701370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4fqt\" (UniqueName: \"kubernetes.io/projected/eb9836da-175a-4bbc-b49d-a7d5e26e7666-kube-api-access-f4fqt\") pod \"monitoring-plugin-85bbbbbf4-c9swq\" (UID: \"eb9836da-175a-4bbc-b49d-a7d5e26e7666\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:03.703809 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.703788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eb9836da-175a-4bbc-b49d-a7d5e26e7666-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-c9swq\" (UID: \"eb9836da-175a-4bbc-b49d-a7d5e26e7666\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:03.710205 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.710185 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4fqt\" (UniqueName: \"kubernetes.io/projected/eb9836da-175a-4bbc-b49d-a7d5e26e7666-kube-api-access-f4fqt\") pod \"monitoring-plugin-85bbbbbf4-c9swq\" (UID: \"eb9836da-175a-4bbc-b49d-a7d5e26e7666\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:03.801056 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.801033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:03.879150 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.879112 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:03.979993 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:03.979967 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:04.059745 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:04.059712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" event={"ID":"599fb9ac-8161-437b-a818-f0f4deb56b80","Type":"ContainerStarted","Data":"13416eebfe73e40b40d764e5de606249ba7e4191ce0abe4b3b93bab8dec3cb20"} Sep 09 09:48:04.069733 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:04.069714 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq"] Sep 09 09:48:04.072213 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:48:04.072183 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9836da_175a_4bbc_b49d_a7d5e26e7666.slice/crio-8d5b7117aeae1fb20a0c704422738d8ec7f514b4e4572d742cd3c24f67eae8f5 WatchSource:0}: Error finding container 8d5b7117aeae1fb20a0c704422738d8ec7f514b4e4572d742cd3c24f67eae8f5: Status 404 returned error can't find the container with id 8d5b7117aeae1fb20a0c704422738d8ec7f514b4e4572d742cd3c24f67eae8f5 Sep 09 09:48:05.016262 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:05.016230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:05.066926 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:05.066848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" event={"ID":"eb9836da-175a-4bbc-b49d-a7d5e26e7666","Type":"ContainerStarted","Data":"8d5b7117aeae1fb20a0c704422738d8ec7f514b4e4572d742cd3c24f67eae8f5"} Sep 09 09:48:06.072843 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.072750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" event={"ID":"599fb9ac-8161-437b-a818-f0f4deb56b80","Type":"ContainerStarted","Data":"510d1d0000fbb93f734eba0cabb72ba67dae8c839cc41fb720b57122f9aa471f"} Sep 09 09:48:06.074379 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.074352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" event={"ID":"eb9836da-175a-4bbc-b49d-a7d5e26e7666","Type":"ContainerStarted","Data":"f7d50c53c103538997538ea9b3c15ef8eb6d3239f9c6e2edc2ed005a5f30a670"} Sep 09 09:48:06.074508 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.074402 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:06.079517 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.079495 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" Sep 09 09:48:06.083321 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.083303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:06.090903 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.090867 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" podStartSLOduration=0.969187402 podStartE2EDuration="3.090852161s" totalImagesPullingTime="2.121664759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:06.089866336 +0000 UTC m=+307.468899529" watchObservedRunningTime="2026-09-09 09:48:06.090852161 +0000 UTC m=+307.469885372" Sep 09 09:48:06.104124 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.104088 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-c9swq" podStartSLOduration=1.366844396 podStartE2EDuration="3.10407499s" totalImagesPullingTime="1.737230594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:06.103557425 +0000 UTC m=+307.482590578" watchObservedRunningTime="2026-09-09 09:48:06.10407499 +0000 UTC m=+307.483108143" Sep 09 09:48:06.123830 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.123809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:48:06.182004 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:06.181978 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:07.999841 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:07.999815 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-685bc57656-7d9nz" Sep 09 09:48:08.143001 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.142972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:08.253264 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.253190 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:08.644783 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.644755 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78b96c8655-hxw8l"] Sep 09 09:48:08.648879 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.648864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.665844 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.665821 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 09:48:08.665959 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.665934 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b96c8655-hxw8l"] Sep 09 09:48:08.666076 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.666061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 09:48:08.666133 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.666063 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 09:48:08.666176 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.666163 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 09:48:08.666735 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.666720 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 09:48:08.666802 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.666766 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 09:48:08.666802 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.666773 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 09:48:08.666906 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.666816 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mw824\"" Sep 09 09:48:08.671438 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.671416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 09:48:08.749099 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.749074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-oauth-config\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.749242 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.749111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-trusted-ca-bundle\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.749242 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.749140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-serving-cert\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.749242 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.749161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-service-ca\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.749242 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.749198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-oauth-serving-cert\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.749242 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.749227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45nj\" (UniqueName: \"kubernetes.io/projected/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-kube-api-access-j45nj\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.749476 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.749297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-config\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.850121 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.850095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45nj\" (UniqueName: \"kubernetes.io/projected/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-kube-api-access-j45nj\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.850238 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.850159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-config\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.850238 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.850208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-oauth-config\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.850359 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.850336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-trusted-ca-bundle\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.850424 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.850394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-serving-cert\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.850471 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.850433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-service-ca\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.850471 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.850464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-oauth-serving-cert\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.851043 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.851007 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-config\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.851182 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.851164 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-oauth-serving-cert\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.851239 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.851184 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-trusted-ca-bundle\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.851303 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.851282 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-service-ca\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.852692 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.852660 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-oauth-config\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.852979 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.852960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-serving-cert\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.858912 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.858893 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45nj\" (UniqueName: \"kubernetes.io/projected/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-kube-api-access-j45nj\") pod \"console-78b96c8655-hxw8l\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:08.957143 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:08.957070 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:09.230421 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:09.230400 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b96c8655-hxw8l"] Sep 09 09:48:09.232646 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:48:09.232621 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e47f3b5_9ba3_4e97_8110_64b8d26b52e4.slice/crio-51f7f1861b7bcf107907a4e7c3f7758342091fbf1892c1b3483047a132bccd99 WatchSource:0}: Error finding container 51f7f1861b7bcf107907a4e7c3f7758342091fbf1892c1b3483047a132bccd99: Status 404 returned error can't find the container with id 51f7f1861b7bcf107907a4e7c3f7758342091fbf1892c1b3483047a132bccd99 Sep 09 09:48:10.092926 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.092881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b96c8655-hxw8l" event={"ID":"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4","Type":"ContainerStarted","Data":"51f7f1861b7bcf107907a4e7c3f7758342091fbf1892c1b3483047a132bccd99"} Sep 09 09:48:10.449268 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.449170 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" podUID="226c79ff-4983-4d5d-9109-c26fccc91d70" containerName="registry" containerID="cri-o://4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee" gracePeriod=30 Sep 09 09:48:10.458344 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.458315 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:10.513077 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.513048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:10.709233 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.709167 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:48:10.767594 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.767568 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-bound-sa-token\") pod \"226c79ff-4983-4d5d-9109-c26fccc91d70\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " Sep 09 09:48:10.767749 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.767617 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5d4b\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-kube-api-access-n5d4b\") pod \"226c79ff-4983-4d5d-9109-c26fccc91d70\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " Sep 09 09:48:10.767749 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.767643 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") pod \"226c79ff-4983-4d5d-9109-c26fccc91d70\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " Sep 09 09:48:10.767749 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.767668 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-installation-pull-secrets\") pod \"226c79ff-4983-4d5d-9109-c26fccc91d70\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " Sep 09 09:48:10.767749 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.767708 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-trusted-ca\") pod \"226c79ff-4983-4d5d-9109-c26fccc91d70\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " Sep 09 09:48:10.767963 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.767891 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-image-registry-private-configuration\") pod \"226c79ff-4983-4d5d-9109-c26fccc91d70\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " Sep 09 09:48:10.767963 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.767936 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-certificates\") pod \"226c79ff-4983-4d5d-9109-c26fccc91d70\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " Sep 09 09:48:10.768057 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.768015 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/226c79ff-4983-4d5d-9109-c26fccc91d70-ca-trust-extracted\") pod \"226c79ff-4983-4d5d-9109-c26fccc91d70\" (UID: \"226c79ff-4983-4d5d-9109-c26fccc91d70\") " Sep 09 09:48:10.768250 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.768156 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "226c79ff-4983-4d5d-9109-c26fccc91d70" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:48:10.768445 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.768315 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-trusted-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:48:10.768445 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.768329 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "226c79ff-4983-4d5d-9109-c26fccc91d70" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:48:10.771014 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.770985 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "226c79ff-4983-4d5d-9109-c26fccc91d70" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:48:10.771130 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.771055 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "226c79ff-4983-4d5d-9109-c26fccc91d70" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:48:10.771130 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.771112 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-kube-api-access-n5d4b" (OuterVolumeSpecName: "kube-api-access-n5d4b") pod "226c79ff-4983-4d5d-9109-c26fccc91d70" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70"). InnerVolumeSpecName "kube-api-access-n5d4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:48:10.771258 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.771226 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "226c79ff-4983-4d5d-9109-c26fccc91d70" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:48:10.771741 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.771713 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "226c79ff-4983-4d5d-9109-c26fccc91d70" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:48:10.779441 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.779416 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226c79ff-4983-4d5d-9109-c26fccc91d70-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "226c79ff-4983-4d5d-9109-c26fccc91d70" (UID: "226c79ff-4983-4d5d-9109-c26fccc91d70"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:48:10.868972 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.868942 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-bound-sa-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:48:10.868972 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.868972 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5d4b\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-kube-api-access-n5d4b\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:48:10.869168 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.868982 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:48:10.869168 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.868991 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-installation-pull-secrets\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:48:10.869168 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.869000 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/226c79ff-4983-4d5d-9109-c26fccc91d70-image-registry-private-configuration\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:48:10.869168 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.869015 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/226c79ff-4983-4d5d-9109-c26fccc91d70-registry-certificates\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:48:10.869168 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:10.869028 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/226c79ff-4983-4d5d-9109-c26fccc91d70-ca-trust-extracted\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:48:11.097891 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.097849 2578 generic.go:356] "Generic (PLEG): container finished" podID="226c79ff-4983-4d5d-9109-c26fccc91d70" containerID="4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee" exitCode=0 Sep 09 09:48:11.098072 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.097896 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" event={"ID":"226c79ff-4983-4d5d-9109-c26fccc91d70","Type":"ContainerDied","Data":"4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee"} Sep 09 09:48:11.098072 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.097914 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" Sep 09 09:48:11.098072 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.097944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76d7d5bd4-lbmxs" event={"ID":"226c79ff-4983-4d5d-9109-c26fccc91d70","Type":"ContainerDied","Data":"76379ab61851cc950f5911e3638fd847679a2f5b7743a75f0caa7973934a6e0f"} Sep 09 09:48:11.098072 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.097984 2578 scope.go:117] "RemoveContainer" containerID="4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee" Sep 09 09:48:11.131909 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.131878 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76d7d5bd4-lbmxs"] Sep 09 09:48:11.131909 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.131906 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76d7d5bd4-lbmxs"] Sep 09 09:48:11.943094 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.943007 2578 scope.go:117] "RemoveContainer" containerID="4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee" Sep 09 09:48:11.943407 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:48:11.943385 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee\": container with ID starting with 4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee not found: ID does not exist" containerID="4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee" Sep 09 09:48:11.943460 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:11.943416 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee"} err="failed to get container status \"4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee\": rpc error: code = NotFound desc = could not find container \"4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee\": container with ID starting with 4d27b6fcaf0589a81fa322b52380725e3f44b71139ff16c7e2066e8212d48aee not found: ID does not exist" Sep 09 09:48:12.103857 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:12.103827 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b96c8655-hxw8l" event={"ID":"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4","Type":"ContainerStarted","Data":"e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b"} Sep 09 09:48:12.124652 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:12.124609 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78b96c8655-hxw8l" podStartSLOduration=1.367540338 podStartE2EDuration="4.12459531s" totalImagesPullingTime="2.757054972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:12.12391595 +0000 UTC m=+313.502949132" watchObservedRunningTime="2026-09-09 09:48:12.12459531 +0000 UTC m=+313.503628464" Sep 09 09:48:13.128287 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:13.128255 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226c79ff-4983-4d5d-9109-c26fccc91d70" path="/var/lib/kubelet/pods/226c79ff-4983-4d5d-9109-c26fccc91d70/volumes" Sep 09 09:48:13.988314 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:13.988279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:14.038087 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:14.038061 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:14.596171 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:14.596139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:14.696925 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:14.696893 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:17.722201 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:17.722153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:18.958161 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:18.958121 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:18.958534 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:18.958191 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:18.962959 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:18.962938 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:19.131611 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:19.131580 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:48:19.281710 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:19.281616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:19.389560 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:19.389532 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:19.444911 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:19.444883 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:23.393489 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:23.393444 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:23.393895 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:23.393515 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:26.180508 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:26.180474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:26.245831 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:26.245803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:48:39.191299 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:39.191224 2578 generic.go:356] "Generic (PLEG): container finished" podID="575ef0e1-b900-4149-9c9a-e58f5efece73" containerID="c2c76b8d8b544e7247bafdd98680296024b0cc6a7b88cbbceb8c1a6318873201" exitCode=0 Sep 09 09:48:39.191611 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:39.191302 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" event={"ID":"575ef0e1-b900-4149-9c9a-e58f5efece73","Type":"ContainerDied","Data":"c2c76b8d8b544e7247bafdd98680296024b0cc6a7b88cbbceb8c1a6318873201"} Sep 09 09:48:39.191611 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:39.191577 2578 scope.go:117] "RemoveContainer" containerID="c2c76b8d8b544e7247bafdd98680296024b0cc6a7b88cbbceb8c1a6318873201" Sep 09 09:48:40.196182 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:40.196143 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-4zj5b" event={"ID":"575ef0e1-b900-4149-9c9a-e58f5efece73","Type":"ContainerStarted","Data":"11c8a2a9056bc29695fbdf11744437c828781e57774b8c9b43450d7ef3b96c81"} Sep 09 09:48:43.398291 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:43.398262 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:48:43.401938 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:48:43.401915 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-848656fc4c-jh4pw" Sep 09 09:49:11.435910 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:11.435876 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:11.491402 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:11.491380 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:11.855905 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:11.855871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:11.916183 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:11.916148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:12.933014 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:12.932977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:49:12.935488 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:12.935464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f10052-2bb2-49e8-a943-46101a17508c-metrics-certs\") pod \"network-metrics-daemon-g26bw\" (UID: \"d9f10052-2bb2-49e8-a943-46101a17508c\") " pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:49:13.026834 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:13.026811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wwtw\"" Sep 09 09:49:13.035052 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:13.035031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g26bw" Sep 09 09:49:13.307553 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:13.307535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g26bw"] Sep 09 09:49:13.309910 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:49:13.309884 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f10052_2bb2_49e8_a943_46101a17508c.slice/crio-e8149b616e1bc922f6bcfcc2871d7c1943b301514434c65ba2b24a84d7483195 WatchSource:0}: Error finding container e8149b616e1bc922f6bcfcc2871d7c1943b301514434c65ba2b24a84d7483195: Status 404 returned error can't find the container with id e8149b616e1bc922f6bcfcc2871d7c1943b301514434c65ba2b24a84d7483195 Sep 09 09:49:14.310163 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:14.310129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g26bw" event={"ID":"d9f10052-2bb2-49e8-a943-46101a17508c","Type":"ContainerStarted","Data":"e8149b616e1bc922f6bcfcc2871d7c1943b301514434c65ba2b24a84d7483195"} Sep 09 09:49:15.317616 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:15.317578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g26bw" event={"ID":"d9f10052-2bb2-49e8-a943-46101a17508c","Type":"ContainerStarted","Data":"40c9498ca8a36f10674058217eaea74461178d729e0443b4c4dce736781ed6ef"} Sep 09 09:49:15.317992 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:15.317635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g26bw" event={"ID":"d9f10052-2bb2-49e8-a943-46101a17508c","Type":"ContainerStarted","Data":"06a6b314d59d69fd58fdf0f6e1e61514639b546706abd3e34cbbb4aaea4200c7"} Sep 09 09:49:15.334930 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:15.334883 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g26bw" podStartSLOduration=375.378274914 podStartE2EDuration="6m16.33486839s" totalImagesPullingTime="956.593476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:49:15.333122839 +0000 UTC m=+376.712156012" watchObservedRunningTime="2026-09-09 09:49:15.33486839 +0000 UTC m=+376.713901544" Sep 09 09:49:15.422322 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:15.422288 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:15.481624 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:15.481597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:18.001335 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:18.001290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:18.222528 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:18.222486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:27.139615 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:27.139586 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:27.259144 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:27.259107 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:37.925748 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:37.925705 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78b96c8655-hxw8l"] Sep 09 09:49:38.032196 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:38.032150 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:38.132525 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:38.132491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:49:38.195885 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:49:38.195819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:00.199799 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:00.199765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:02.952346 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:02.952305 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78b96c8655-hxw8l" podUID="9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" containerName="console" containerID="cri-o://e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b" gracePeriod=15 Sep 09 09:50:03.187856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.187833 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:50:03.271932 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.271871 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-service-ca\") pod \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " Sep 09 09:50:03.271932 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.271929 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-oauth-serving-cert\") pod \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " Sep 09 09:50:03.272120 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.271946 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j45nj\" (UniqueName: \"kubernetes.io/projected/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-kube-api-access-j45nj\") pod \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " Sep 09 09:50:03.272120 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.271968 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-serving-cert\") pod \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " Sep 09 09:50:03.272120 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.272000 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-oauth-config\") pod \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " Sep 09 09:50:03.272120 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.272015 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-config\") pod \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " Sep 09 09:50:03.272120 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.272047 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-trusted-ca-bundle\") pod \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\" (UID: \"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4\") " Sep 09 09:50:03.272459 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.272431 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" (UID: "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:50:03.272573 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.272521 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" (UID: "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:50:03.272573 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.272536 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-config" (OuterVolumeSpecName: "console-config") pod "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" (UID: "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:50:03.272883 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.272581 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" (UID: "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:50:03.274325 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.274300 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-kube-api-access-j45nj" (OuterVolumeSpecName: "kube-api-access-j45nj") pod "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" (UID: "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4"). InnerVolumeSpecName "kube-api-access-j45nj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:50:03.274419 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.274348 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" (UID: "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:50:03.274419 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.274386 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" (UID: "9e47f3b5-9ba3-4e97-8110-64b8d26b52e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:50:03.372499 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.372470 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-trusted-ca-bundle\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:50:03.372499 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.372492 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:50:03.372499 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.372502 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-oauth-serving-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:50:03.372718 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.372511 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j45nj\" (UniqueName: \"kubernetes.io/projected/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-kube-api-access-j45nj\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:50:03.372718 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.372520 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-serving-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:50:03.372718 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.372528 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-oauth-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:50:03.372718 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.372535 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4-console-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:50:03.494877 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.494840 2578 generic.go:356] "Generic (PLEG): container finished" podID="9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" containerID="e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b" exitCode=0 Sep 09 09:50:03.494877 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.494879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b96c8655-hxw8l" event={"ID":"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4","Type":"ContainerDied","Data":"e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b"} Sep 09 09:50:03.495103 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.494890 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b96c8655-hxw8l" Sep 09 09:50:03.495103 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.494927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b96c8655-hxw8l" event={"ID":"9e47f3b5-9ba3-4e97-8110-64b8d26b52e4","Type":"ContainerDied","Data":"51f7f1861b7bcf107907a4e7c3f7758342091fbf1892c1b3483047a132bccd99"} Sep 09 09:50:03.495103 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.494952 2578 scope.go:117] "RemoveContainer" containerID="e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b" Sep 09 09:50:03.503302 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.503284 2578 scope.go:117] "RemoveContainer" containerID="e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b" Sep 09 09:50:03.503557 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:50:03.503539 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b\": container with ID starting with e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b not found: ID does not exist" containerID="e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b" Sep 09 09:50:03.503599 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.503565 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b"} err="failed to get container status \"e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b\": rpc error: code = NotFound desc = could not find container \"e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b\": container with ID starting with e03b76c7ba7b45e186d1a0c934220fe74af35cb64f8af5d441e78074b41ffe4b not found: ID does not exist" Sep 09 09:50:03.514637 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.514606 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78b96c8655-hxw8l"] Sep 09 09:50:03.518594 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:03.518575 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78b96c8655-hxw8l"] Sep 09 09:50:05.128542 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:05.128508 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" path="/var/lib/kubelet/pods/9e47f3b5-9ba3-4e97-8110-64b8d26b52e4/volumes" Sep 09 09:50:33.264234 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:33.264149 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:33.318222 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:33.318191 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:35.221410 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.221378 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8fcfbc6d4-g24td"] Sep 09 09:50:35.221856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.221603 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" containerName="console" Sep 09 09:50:35.221856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.221614 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" containerName="console" Sep 09 09:50:35.221856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.221624 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226c79ff-4983-4d5d-9109-c26fccc91d70" containerName="registry" Sep 09 09:50:35.221856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.221629 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="226c79ff-4983-4d5d-9109-c26fccc91d70" containerName="registry" Sep 09 09:50:35.221856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.221691 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="226c79ff-4983-4d5d-9109-c26fccc91d70" containerName="registry" Sep 09 09:50:35.221856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.221698 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e47f3b5-9ba3-4e97-8110-64b8d26b52e4" containerName="console" Sep 09 09:50:35.224472 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.224450 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.226961 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.226942 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 09:50:35.227907 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.227890 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 09:50:35.228012 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.227926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 09:50:35.228012 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.227940 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 09:50:35.228111 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.228060 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 09:50:35.228182 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.228167 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 09:50:35.228259 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.228244 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 09:50:35.228395 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.228376 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mw824\"" Sep 09 09:50:35.232215 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.232194 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 09:50:35.236516 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.236497 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8fcfbc6d4-g24td"] Sep 09 09:50:35.281471 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.281443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:35.337590 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.337567 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:35.381816 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.381794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-config\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.381885 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.381822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-serving-cert\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.381885 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.381848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-trusted-ca-bundle\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.381885 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.381865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-oauth-config\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.381987 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.381927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-service-ca\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.381987 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.381959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-oauth-serving-cert\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.382047 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.381984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6764\" (UniqueName: \"kubernetes.io/projected/b3cd0172-6e33-4113-8f75-f64433b5f8cd-kube-api-access-r6764\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.423026 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.422995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:35.477969 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.477900 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:35.482975 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.482959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-config\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483032 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.482986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-serving-cert\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483032 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-trusted-ca-bundle\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483032 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-oauth-config\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483185 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-service-ca\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483185 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-oauth-serving-cert\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483185 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6764\" (UniqueName: \"kubernetes.io/projected/b3cd0172-6e33-4113-8f75-f64433b5f8cd-kube-api-access-r6764\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483806 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483785 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-oauth-serving-cert\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483903 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483816 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-config\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483992 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-service-ca\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.483992 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.483933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-trusted-ca-bundle\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.486096 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.486077 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-oauth-config\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.486195 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.486163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-serving-cert\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.490890 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.490872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6764\" (UniqueName: \"kubernetes.io/projected/b3cd0172-6e33-4113-8f75-f64433b5f8cd-kube-api-access-r6764\") pod \"console-8fcfbc6d4-g24td\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.534743 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.534720 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:35.804599 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:35.804578 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8fcfbc6d4-g24td"] Sep 09 09:50:35.807147 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:50:35.807121 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cd0172_6e33_4113_8f75_f64433b5f8cd.slice/crio-75a6ffc934be249965456ede652700b96d558b7ccdfe086b85f1115f5f32b104 WatchSource:0}: Error finding container 75a6ffc934be249965456ede652700b96d558b7ccdfe086b85f1115f5f32b104: Status 404 returned error can't find the container with id 75a6ffc934be249965456ede652700b96d558b7ccdfe086b85f1115f5f32b104 Sep 09 09:50:36.016851 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:36.016810 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:36.117518 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:36.117450 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:36.614347 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:36.614318 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8fcfbc6d4-g24td" event={"ID":"b3cd0172-6e33-4113-8f75-f64433b5f8cd","Type":"ContainerStarted","Data":"34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b"} Sep 09 09:50:36.614716 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:36.614367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8fcfbc6d4-g24td" event={"ID":"b3cd0172-6e33-4113-8f75-f64433b5f8cd","Type":"ContainerStarted","Data":"75a6ffc934be249965456ede652700b96d558b7ccdfe086b85f1115f5f32b104"} Sep 09 09:50:36.631803 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:36.631760 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8fcfbc6d4-g24td" podStartSLOduration=1.631746141 podStartE2EDuration="1.631746141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:50:36.630802939 +0000 UTC m=+458.009836119" watchObservedRunningTime="2026-09-09 09:50:36.631746141 +0000 UTC m=+458.010779294" Sep 09 09:50:37.292366 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:37.292281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:45.217971 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.217935 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:45.319757 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.319733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:45.535900 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.535810 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:45.535900 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.535867 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:45.540950 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.540925 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:45.648323 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.648301 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:50:45.791769 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.791695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:45.848506 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.848481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:45.899925 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:45.899893 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:56.190109 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:56.190074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:50:56.290990 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:50:56.290966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:52:16.691433 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:16.691399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:52:30.225007 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:30.224975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:52:38.207243 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.207210 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:52:38.696620 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.696586 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7"] Sep 09 09:52:38.699621 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.699606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 09:52:38.702010 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.701989 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 09 09:52:38.702010 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.702002 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-52584\"" Sep 09 09:52:38.703006 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.702988 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 09 09:52:38.707502 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.707480 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7"] Sep 09 09:52:38.831766 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.831741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgjg\" (UniqueName: \"kubernetes.io/projected/97811035-b7b6-4770-859e-b4805b0b2f71-kube-api-access-pvgjg\") pod \"feast-operator-controller-manager-8c8bcc6f5-hp9k7\" (UID: \"97811035-b7b6-4770-859e-b4805b0b2f71\") " pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 09:52:38.932878 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.932851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgjg\" (UniqueName: \"kubernetes.io/projected/97811035-b7b6-4770-859e-b4805b0b2f71-kube-api-access-pvgjg\") pod \"feast-operator-controller-manager-8c8bcc6f5-hp9k7\" (UID: \"97811035-b7b6-4770-859e-b4805b0b2f71\") " pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 09:52:38.941575 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:38.941549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgjg\" (UniqueName: \"kubernetes.io/projected/97811035-b7b6-4770-859e-b4805b0b2f71-kube-api-access-pvgjg\") pod \"feast-operator-controller-manager-8c8bcc6f5-hp9k7\" (UID: \"97811035-b7b6-4770-859e-b4805b0b2f71\") " pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 09:52:39.010127 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:39.010067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 09:52:39.278937 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:39.278915 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7"] Sep 09 09:52:39.281267 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:52:39.281235 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97811035_b7b6_4770_859e_b4805b0b2f71.slice/crio-1d00a5108831bb963598e6e336247924a59af04640c1a33e0ba9645c6642d071 WatchSource:0}: Error finding container 1d00a5108831bb963598e6e336247924a59af04640c1a33e0ba9645c6642d071: Status 404 returned error can't find the container with id 1d00a5108831bb963598e6e336247924a59af04640c1a33e0ba9645c6642d071 Sep 09 09:52:40.051693 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:40.051641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" event={"ID":"97811035-b7b6-4770-859e-b4805b0b2f71","Type":"ContainerStarted","Data":"1d00a5108831bb963598e6e336247924a59af04640c1a33e0ba9645c6642d071"} Sep 09 09:52:40.353979 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:40.353889 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:52:42.060902 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:42.060859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" event={"ID":"97811035-b7b6-4770-859e-b4805b0b2f71","Type":"ContainerStarted","Data":"7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269"} Sep 09 09:52:42.061256 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:42.060963 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 09:52:42.076534 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:42.076479 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" podStartSLOduration=1.585992012 podStartE2EDuration="4.076461821s" totalImagesPullingTime="2.490469809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:52:42.075621868 +0000 UTC m=+583.454655040" watchObservedRunningTime="2026-09-09 09:52:42.076461821 +0000 UTC m=+583.455494978" Sep 09 09:52:53.067626 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:52:53.067587 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 09:53:00.558420 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:00.558384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:00.658734 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:00.658703 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:00.844519 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:00.844446 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:01.374097 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:01.374064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:01.431003 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:01.430974 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:10.865173 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:10.865138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:11.795461 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:11.795426 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8fcfbc6d4-g24td"] Sep 09 09:53:11.902555 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:11.902519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:11.956869 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:11.956827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:12.011357 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:12.011316 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:16.262437 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:16.262389 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:16.362460 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:16.362428 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:16.857341 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:16.857288 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:16.951640 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:16.951608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:17.053445 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:17.053392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:17.152943 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:17.152869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:17.521554 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:17.521472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:17.592417 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:17.592391 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:19.133580 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:19.133550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:19.194131 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:19.194106 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:21.127181 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:21.127097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:53:36.816657 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:36.816620 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8fcfbc6d4-g24td" podUID="b3cd0172-6e33-4113-8f75-f64433b5f8cd" containerName="console" containerID="cri-o://34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b" gracePeriod=15 Sep 09 09:53:37.055022 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.054997 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:53:37.134651 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.134581 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-oauth-config\") pod \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " Sep 09 09:53:37.134651 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.134626 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-service-ca\") pod \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " Sep 09 09:53:37.134878 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.134664 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-config\") pod \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " Sep 09 09:53:37.134878 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.134704 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6764\" (UniqueName: \"kubernetes.io/projected/b3cd0172-6e33-4113-8f75-f64433b5f8cd-kube-api-access-r6764\") pod \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " Sep 09 09:53:37.134878 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.134740 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-trusted-ca-bundle\") pod \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " Sep 09 09:53:37.134878 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.134814 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-serving-cert\") pod \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " Sep 09 09:53:37.134878 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.134846 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-oauth-serving-cert\") pod \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\" (UID: \"b3cd0172-6e33-4113-8f75-f64433b5f8cd\") " Sep 09 09:53:37.135145 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.135016 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3cd0172-6e33-4113-8f75-f64433b5f8cd" (UID: "b3cd0172-6e33-4113-8f75-f64433b5f8cd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:53:37.135145 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.135024 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-config" (OuterVolumeSpecName: "console-config") pod "b3cd0172-6e33-4113-8f75-f64433b5f8cd" (UID: "b3cd0172-6e33-4113-8f75-f64433b5f8cd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:53:37.135242 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.135219 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3cd0172-6e33-4113-8f75-f64433b5f8cd" (UID: "b3cd0172-6e33-4113-8f75-f64433b5f8cd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:53:37.135369 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.135271 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3cd0172-6e33-4113-8f75-f64433b5f8cd" (UID: "b3cd0172-6e33-4113-8f75-f64433b5f8cd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:53:37.136856 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.136835 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3cd0172-6e33-4113-8f75-f64433b5f8cd-kube-api-access-r6764" (OuterVolumeSpecName: "kube-api-access-r6764") pod "b3cd0172-6e33-4113-8f75-f64433b5f8cd" (UID: "b3cd0172-6e33-4113-8f75-f64433b5f8cd"). InnerVolumeSpecName "kube-api-access-r6764". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:53:37.136955 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.136872 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3cd0172-6e33-4113-8f75-f64433b5f8cd" (UID: "b3cd0172-6e33-4113-8f75-f64433b5f8cd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:53:37.137020 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.137004 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3cd0172-6e33-4113-8f75-f64433b5f8cd" (UID: "b3cd0172-6e33-4113-8f75-f64433b5f8cd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:53:37.236049 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.236017 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-trusted-ca-bundle\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:53:37.236049 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.236047 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-serving-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:53:37.236049 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.236056 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-oauth-serving-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:53:37.236204 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.236065 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-oauth-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:53:37.236204 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.236073 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:53:37.236204 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.236081 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3cd0172-6e33-4113-8f75-f64433b5f8cd-console-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:53:37.236204 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.236088 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6764\" (UniqueName: \"kubernetes.io/projected/b3cd0172-6e33-4113-8f75-f64433b5f8cd-kube-api-access-r6764\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:53:37.251062 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.251033 2578 generic.go:356] "Generic (PLEG): container finished" podID="b3cd0172-6e33-4113-8f75-f64433b5f8cd" containerID="34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b" exitCode=0 Sep 09 09:53:37.251140 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.251064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8fcfbc6d4-g24td" event={"ID":"b3cd0172-6e33-4113-8f75-f64433b5f8cd","Type":"ContainerDied","Data":"34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b"} Sep 09 09:53:37.251140 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.251088 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8fcfbc6d4-g24td" Sep 09 09:53:37.251140 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.251104 2578 scope.go:117] "RemoveContainer" containerID="34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b" Sep 09 09:53:37.251239 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.251094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8fcfbc6d4-g24td" event={"ID":"b3cd0172-6e33-4113-8f75-f64433b5f8cd","Type":"ContainerDied","Data":"75a6ffc934be249965456ede652700b96d558b7ccdfe086b85f1115f5f32b104"} Sep 09 09:53:37.259325 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.259304 2578 scope.go:117] "RemoveContainer" containerID="34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b" Sep 09 09:53:37.259603 ip-10-0-143-228 kubenswrapper[2578]: E0909 09:53:37.259585 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b\": container with ID starting with 34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b not found: ID does not exist" containerID="34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b" Sep 09 09:53:37.259663 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.259615 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b"} err="failed to get container status \"34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b\": rpc error: code = NotFound desc = could not find container \"34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b\": container with ID starting with 34b3a2632a055d51a2f0bfd8aaeaf49b3a3da0788ccc2f4c944f1974c899900b not found: ID does not exist" Sep 09 09:53:37.272194 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.272176 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8fcfbc6d4-g24td"] Sep 09 09:53:37.275799 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:37.275780 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8fcfbc6d4-g24td"] Sep 09 09:53:39.128963 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:53:39.128936 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3cd0172-6e33-4113-8f75-f64433b5f8cd" path="/var/lib/kubelet/pods/b3cd0172-6e33-4113-8f75-f64433b5f8cd/volumes" Sep 09 09:54:06.463786 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:54:06.463753 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:07.235565 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:07.235355 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:07.328068 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:07.328039 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:07.522772 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:07.522702 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:07.620442 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:07.620406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:07.684145 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:07.684117 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:07.815130 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:07.815098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:07.937372 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:07.937341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:08.186321 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:08.186237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:55:30.688944 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:55:30.688902 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:56:30.394810 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:56:30.394726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:56:32.097369 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:56:32.097335 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:56:32.197587 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:56:32.197553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:56:32.537511 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:56:32.537434 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:56:32.637230 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:56:32.637196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:56:32.867490 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:56:32.867461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:56:33.062542 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:56:33.062514 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:56:33.333095 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:56:33.333062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:57:10.210057 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:57:10.210019 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:57:22.264364 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:57:22.264330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:58:12.820754 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:58:12.820663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:58:13.834044 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:58:13.834007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:58:18.104382 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:58:18.104342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:58:55.942021 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:58:55.941982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:58:56.216885 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:58:56.216791 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:58:56.317598 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:58:56.317556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:59:06.966806 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:06.966743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:59:07.064524 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:07.064453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:59:07.174605 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:07.174568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:59:07.268735 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:07.268618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:59:07.877076 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:07.877044 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:59:32.387202 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:32.387127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 09:59:33.717266 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.717225 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-w7w5t"] Sep 09 09:59:33.717623 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.717513 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3cd0172-6e33-4113-8f75-f64433b5f8cd" containerName="console" Sep 09 09:59:33.717623 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.717524 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3cd0172-6e33-4113-8f75-f64433b5f8cd" containerName="console" Sep 09 09:59:33.717623 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.717577 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3cd0172-6e33-4113-8f75-f64433b5f8cd" containerName="console" Sep 09 09:59:33.720489 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.720473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-w7w5t" Sep 09 09:59:33.723454 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.723431 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 09 09:59:33.723574 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.723488 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 09 09:59:33.724458 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.724443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 09 09:59:33.724556 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.724541 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-8hwfs\"" Sep 09 09:59:33.731054 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.731035 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-w7w5t"] Sep 09 09:59:33.804983 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.804957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvn79\" (UniqueName: \"kubernetes.io/projected/ed33890a-9e2e-4488-9f41-b95f640013bc-kube-api-access-cvn79\") pod \"feast-test-apply-w7w5t\" (UID: \"ed33890a-9e2e-4488-9f41-b95f640013bc\") " pod="test-ns-feast/feast-test-apply-w7w5t" Sep 09 09:59:33.905474 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.905438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvn79\" (UniqueName: \"kubernetes.io/projected/ed33890a-9e2e-4488-9f41-b95f640013bc-kube-api-access-cvn79\") pod \"feast-test-apply-w7w5t\" (UID: \"ed33890a-9e2e-4488-9f41-b95f640013bc\") " pod="test-ns-feast/feast-test-apply-w7w5t" Sep 09 09:59:33.914035 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:33.914013 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvn79\" (UniqueName: \"kubernetes.io/projected/ed33890a-9e2e-4488-9f41-b95f640013bc-kube-api-access-cvn79\") pod \"feast-test-apply-w7w5t\" (UID: \"ed33890a-9e2e-4488-9f41-b95f640013bc\") " pod="test-ns-feast/feast-test-apply-w7w5t" Sep 09 09:59:34.041316 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:34.041225 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-w7w5t" Sep 09 09:59:34.316891 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:34.316866 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-w7w5t"] Sep 09 09:59:34.319256 ip-10-0-143-228 kubenswrapper[2578]: W0909 09:59:34.319230 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded33890a_9e2e_4488_9f41_b95f640013bc.slice/crio-ebb1f028be439bb075debb076240802db5d68613a1a5af321c51b6f4e51018a2 WatchSource:0}: Error finding container ebb1f028be439bb075debb076240802db5d68613a1a5af321c51b6f4e51018a2: Status 404 returned error can't find the container with id ebb1f028be439bb075debb076240802db5d68613a1a5af321c51b6f4e51018a2 Sep 09 09:59:34.321464 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:34.321449 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 09:59:34.479650 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:34.479617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-w7w5t" event={"ID":"ed33890a-9e2e-4488-9f41-b95f640013bc","Type":"ContainerStarted","Data":"ebb1f028be439bb075debb076240802db5d68613a1a5af321c51b6f4e51018a2"} Sep 09 09:59:40.506330 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:40.506290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-w7w5t" event={"ID":"ed33890a-9e2e-4488-9f41-b95f640013bc","Type":"ContainerStarted","Data":"7938b6b5fc95e4bbb0a556b7633fa4bf8567ebc248a1fcace870bbb65feff9f0"} Sep 09 09:59:47.532345 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:47.532309 2578 generic.go:356] "Generic (PLEG): container finished" podID="ed33890a-9e2e-4488-9f41-b95f640013bc" containerID="7938b6b5fc95e4bbb0a556b7633fa4bf8567ebc248a1fcace870bbb65feff9f0" exitCode=0 Sep 09 09:59:47.532855 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:47.532382 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-w7w5t" event={"ID":"ed33890a-9e2e-4488-9f41-b95f640013bc","Type":"ContainerDied","Data":"7938b6b5fc95e4bbb0a556b7633fa4bf8567ebc248a1fcace870bbb65feff9f0"} Sep 09 09:59:48.537984 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:48.537949 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-w7w5t" event={"ID":"ed33890a-9e2e-4488-9f41-b95f640013bc","Type":"ContainerStarted","Data":"55a56c74c03c897c2495f9a93228c06babf20a07b420d84c40babdceb9e54a8b"} Sep 09 09:59:48.555715 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:48.555644 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-w7w5t" podStartSLOduration=3.145155324 podStartE2EDuration="15.555627421s" totalImagesPullingTime="5.954265332s" totalInitContainerRuntime="6.456206765s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:59:48.554521234 +0000 UTC m=+1009.933554388" watchObservedRunningTime="2026-09-09 09:59:48.555627421 +0000 UTC m=+1009.934660575" Sep 09 09:59:57.571152 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:57.571111 2578 generic.go:356] "Generic (PLEG): container finished" podID="ed33890a-9e2e-4488-9f41-b95f640013bc" containerID="55a56c74c03c897c2495f9a93228c06babf20a07b420d84c40babdceb9e54a8b" exitCode=0 Sep 09 09:59:57.571533 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:57.571163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-w7w5t" event={"ID":"ed33890a-9e2e-4488-9f41-b95f640013bc","Type":"ContainerDied","Data":"55a56c74c03c897c2495f9a93228c06babf20a07b420d84c40babdceb9e54a8b"} Sep 09 09:59:58.700950 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:58.700927 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-w7w5t" Sep 09 09:59:58.795126 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:58.795085 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvn79\" (UniqueName: \"kubernetes.io/projected/ed33890a-9e2e-4488-9f41-b95f640013bc-kube-api-access-cvn79\") pod \"ed33890a-9e2e-4488-9f41-b95f640013bc\" (UID: \"ed33890a-9e2e-4488-9f41-b95f640013bc\") " Sep 09 09:59:58.797408 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:58.797383 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed33890a-9e2e-4488-9f41-b95f640013bc-kube-api-access-cvn79" (OuterVolumeSpecName: "kube-api-access-cvn79") pod "ed33890a-9e2e-4488-9f41-b95f640013bc" (UID: "ed33890a-9e2e-4488-9f41-b95f640013bc"). InnerVolumeSpecName "kube-api-access-cvn79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:59:58.896544 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:58.896466 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvn79\" (UniqueName: \"kubernetes.io/projected/ed33890a-9e2e-4488-9f41-b95f640013bc-kube-api-access-cvn79\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 09:59:59.579966 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:59.579943 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-w7w5t" Sep 09 09:59:59.580145 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:59.579935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-w7w5t" event={"ID":"ed33890a-9e2e-4488-9f41-b95f640013bc","Type":"ContainerDied","Data":"ebb1f028be439bb075debb076240802db5d68613a1a5af321c51b6f4e51018a2"} Sep 09 09:59:59.580145 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:59.580064 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebb1f028be439bb075debb076240802db5d68613a1a5af321c51b6f4e51018a2" Sep 09 09:59:59.753572 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:59.753541 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-w7w5t_ed33890a-9e2e-4488-9f41-b95f640013bc/feast-0/0.log" Sep 09 09:59:59.760078 ip-10-0-143-228 kubenswrapper[2578]: I0909 09:59:59.760056 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-w7w5t_ed33890a-9e2e-4488-9f41-b95f640013bc/feast-1/0.log" Sep 09 10:00:31.840262 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:00:31.840214 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:00:36.832780 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:00:36.832750 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-w7w5t"] Sep 09 10:00:36.843338 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:00:36.843303 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-w7w5t"] Sep 09 10:00:36.944572 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:00:36.944542 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:00:37.128800 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:00:37.128715 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed33890a-9e2e-4488-9f41-b95f640013bc" path="/var/lib/kubelet/pods/ed33890a-9e2e-4488-9f41-b95f640013bc/volumes" Sep 09 10:01:14.373568 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:01:14.373532 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:01:14.478317 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:01:14.478283 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:01:15.070166 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:01:15.070132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:01:15.171181 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:01:15.171144 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:01:15.226214 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:01:15.226179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:01:52.410945 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:01:52.410904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:02:05.213184 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:02:05.213155 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:03:24.291766 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:03:24.291729 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:03:27.259140 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:03:27.259101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:03:29.945386 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:03:29.945352 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:03:35.404918 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:03:35.404883 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:03:35.507347 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:03:35.507315 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:03:35.819911 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:03:35.819884 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:03:35.875214 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:03:35.875188 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:03:58.045608 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:03:58.045533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:04:01.286117 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:04:01.286080 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:04:01.386432 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:04:01.386405 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:04:01.453744 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:04:01.453715 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:04:01.994308 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:04:01.994273 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:04:41.197778 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:04:41.197743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:46.832140 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:46.832062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:48.838553 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:48.838519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:49.172991 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.172922 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7"] Sep 09 10:05:49.173134 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.173109 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" podUID="97811035-b7b6-4770-859e-b4805b0b2f71" containerName="manager" containerID="cri-o://7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269" gracePeriod=10 Sep 09 10:05:49.185995 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.185935 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:49.429125 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.429063 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 10:05:49.452399 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.452375 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvgjg\" (UniqueName: \"kubernetes.io/projected/97811035-b7b6-4770-859e-b4805b0b2f71-kube-api-access-pvgjg\") pod \"97811035-b7b6-4770-859e-b4805b0b2f71\" (UID: \"97811035-b7b6-4770-859e-b4805b0b2f71\") " Sep 09 10:05:49.457024 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.456998 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97811035-b7b6-4770-859e-b4805b0b2f71-kube-api-access-pvgjg" (OuterVolumeSpecName: "kube-api-access-pvgjg") pod "97811035-b7b6-4770-859e-b4805b0b2f71" (UID: "97811035-b7b6-4770-859e-b4805b0b2f71"). InnerVolumeSpecName "kube-api-access-pvgjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 10:05:49.468664 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.468634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:49.552974 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.552944 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvgjg\" (UniqueName: \"kubernetes.io/projected/97811035-b7b6-4770-859e-b4805b0b2f71-kube-api-access-pvgjg\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 10:05:49.562008 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.561982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:49.800050 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.800017 2578 generic.go:356] "Generic (PLEG): container finished" podID="97811035-b7b6-4770-859e-b4805b0b2f71" containerID="7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269" exitCode=0 Sep 09 10:05:49.800171 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.800061 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" event={"ID":"97811035-b7b6-4770-859e-b4805b0b2f71","Type":"ContainerDied","Data":"7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269"} Sep 09 10:05:49.800171 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.800067 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" Sep 09 10:05:49.800171 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.800115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7" event={"ID":"97811035-b7b6-4770-859e-b4805b0b2f71","Type":"ContainerDied","Data":"1d00a5108831bb963598e6e336247924a59af04640c1a33e0ba9645c6642d071"} Sep 09 10:05:49.800171 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.800147 2578 scope.go:117] "RemoveContainer" containerID="7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269" Sep 09 10:05:49.808501 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.808481 2578 scope.go:117] "RemoveContainer" containerID="7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269" Sep 09 10:05:49.808785 ip-10-0-143-228 kubenswrapper[2578]: E0909 10:05:49.808761 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269\": container with ID starting with 7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269 not found: ID does not exist" containerID="7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269" Sep 09 10:05:49.808883 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.808793 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269"} err="failed to get container status \"7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269\": rpc error: code = NotFound desc = could not find container \"7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269\": container with ID starting with 7cfbaa8c0316125ea0d21db681126a52e4cbcebdeb8c737c3bc01d6f41793269 not found: ID does not exist" Sep 09 10:05:49.820386 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.820365 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7"] Sep 09 10:05:49.829038 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:49.829015 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8c8bcc6f5-hp9k7"] Sep 09 10:05:51.127932 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:51.127901 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97811035-b7b6-4770-859e-b4805b0b2f71" path="/var/lib/kubelet/pods/97811035-b7b6-4770-859e-b4805b0b2f71/volumes" Sep 09 10:05:51.905002 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:51.904965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:54.275335 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:54.275305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:54.338110 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:54.338081 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:59.142874 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:59.142846 2578 scope.go:117] "RemoveContainer" containerID="7938b6b5fc95e4bbb0a556b7633fa4bf8567ebc248a1fcace870bbb65feff9f0" Sep 09 10:05:59.150060 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:59.150042 2578 scope.go:117] "RemoveContainer" containerID="55a56c74c03c897c2495f9a93228c06babf20a07b420d84c40babdceb9e54a8b" Sep 09 10:05:59.587287 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:59.587260 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:05:59.683119 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:05:59.683071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:00.126874 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.126816 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:00.132358 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132334 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm"] Sep 09 10:06:00.132575 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132564 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97811035-b7b6-4770-859e-b4805b0b2f71" containerName="manager" Sep 09 10:06:00.132623 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132577 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="97811035-b7b6-4770-859e-b4805b0b2f71" containerName="manager" Sep 09 10:06:00.132623 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132587 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed33890a-9e2e-4488-9f41-b95f640013bc" containerName="feast-0" Sep 09 10:06:00.132623 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132593 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed33890a-9e2e-4488-9f41-b95f640013bc" containerName="feast-0" Sep 09 10:06:00.132623 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132599 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed33890a-9e2e-4488-9f41-b95f640013bc" containerName="feast-1" Sep 09 10:06:00.132623 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132604 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed33890a-9e2e-4488-9f41-b95f640013bc" containerName="feast-1" Sep 09 10:06:00.132822 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132656 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="97811035-b7b6-4770-859e-b4805b0b2f71" containerName="manager" Sep 09 10:06:00.132822 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.132662 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed33890a-9e2e-4488-9f41-b95f640013bc" containerName="feast-1" Sep 09 10:06:00.136653 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.136637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:06:00.139653 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.139636 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-kc2tn\"" Sep 09 10:06:00.139748 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.139694 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 09 10:06:00.140753 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.140734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 09 10:06:00.148211 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.148188 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm"] Sep 09 10:06:00.220201 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.220176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qgrb\" (UniqueName: \"kubernetes.io/projected/dd1952cc-4b52-48d3-b4a5-e4d71bba72ac-kube-api-access-4qgrb\") pod \"feast-operator-controller-manager-689b877b4b-nj7tm\" (UID: \"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:06:00.321323 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.321279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qgrb\" (UniqueName: \"kubernetes.io/projected/dd1952cc-4b52-48d3-b4a5-e4d71bba72ac-kube-api-access-4qgrb\") pod \"feast-operator-controller-manager-689b877b4b-nj7tm\" (UID: \"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:06:00.332063 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.332042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qgrb\" (UniqueName: \"kubernetes.io/projected/dd1952cc-4b52-48d3-b4a5-e4d71bba72ac-kube-api-access-4qgrb\") pod \"feast-operator-controller-manager-689b877b4b-nj7tm\" (UID: \"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:06:00.446704 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.446632 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:06:00.719790 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.719721 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm"] Sep 09 10:06:00.722624 ip-10-0-143-228 kubenswrapper[2578]: W0909 10:06:00.722596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1952cc_4b52_48d3_b4a5_e4d71bba72ac.slice/crio-79f5dee24359649ebbc4c971a0545ef0b25679b69ccd8fde7c4f998b0eab1baa WatchSource:0}: Error finding container 79f5dee24359649ebbc4c971a0545ef0b25679b69ccd8fde7c4f998b0eab1baa: Status 404 returned error can't find the container with id 79f5dee24359649ebbc4c971a0545ef0b25679b69ccd8fde7c4f998b0eab1baa Sep 09 10:06:00.724929 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.724915 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 10:06:00.840475 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:00.840449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" event={"ID":"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac","Type":"ContainerStarted","Data":"79f5dee24359649ebbc4c971a0545ef0b25679b69ccd8fde7c4f998b0eab1baa"} Sep 09 10:06:04.856537 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:04.856502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" event={"ID":"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac","Type":"ContainerStarted","Data":"da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c"} Sep 09 10:06:04.856916 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:04.856644 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:06:04.874021 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:04.873973 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" podStartSLOduration=1.2457922240000001 podStartE2EDuration="4.873960426s" totalImagesPullingTime="3.628168202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 10:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 10:06:04.872993982 +0000 UTC m=+1386.252027158" watchObservedRunningTime="2026-09-09 10:06:04.873960426 +0000 UTC m=+1386.252993580" Sep 09 10:06:15.861921 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:15.861891 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:06:16.355864 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:16.355836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:16.460165 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:16.460136 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:27.741371 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:27.741337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:27.841581 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:27.841547 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:27.907836 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:27.907808 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:29.246013 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:29.245958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:29.344720 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:29.344657 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:06:29.846039 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:06:29.846012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:07:11.642240 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:07:11.642201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:07:17.212059 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:07:17.212026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:07:43.890973 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:07:43.890941 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:08:12.570168 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:08:12.570137 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:08:12.632617 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:08:12.632589 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:09:33.233897 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:09:33.233857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:09:36.100952 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:09:36.100921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:09:36.199666 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:09:36.199639 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:09:36.526611 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:09:36.526541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:09:36.624534 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:09:36.624502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:09:36.774408 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:09:36.774375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:09:36.914934 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:09:36.914907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:09:37.105000 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:09:37.104954 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:10:05.365905 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:10:05.365870 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:10:05.422135 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:10:05.422103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:11:21.106905 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:11:21.106832 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:11:21.335807 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:11:21.335781 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:11:21.425768 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:11:21.425690 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:11:26.427826 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:11:26.427790 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:03.990995 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:03.989602 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:04.110958 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:04.110926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:09.586806 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:09.586774 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:09.642608 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:09.642583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:09.702243 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:09.702216 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm"] Sep 09 10:12:09.702495 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:09.702451 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" podUID="dd1952cc-4b52-48d3-b4a5-e4d71bba72ac" containerName="manager" containerID="cri-o://da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c" gracePeriod=10 Sep 09 10:12:09.940549 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:09.940525 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:12:10.082025 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.081996 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qgrb\" (UniqueName: \"kubernetes.io/projected/dd1952cc-4b52-48d3-b4a5-e4d71bba72ac-kube-api-access-4qgrb\") pod \"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac\" (UID: \"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac\") " Sep 09 10:12:10.084083 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.084058 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd1952cc-4b52-48d3-b4a5-e4d71bba72ac-kube-api-access-4qgrb" (OuterVolumeSpecName: "kube-api-access-4qgrb") pod "dd1952cc-4b52-48d3-b4a5-e4d71bba72ac" (UID: "dd1952cc-4b52-48d3-b4a5-e4d71bba72ac"). InnerVolumeSpecName "kube-api-access-4qgrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 10:12:10.108385 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.108354 2578 generic.go:356] "Generic (PLEG): container finished" podID="dd1952cc-4b52-48d3-b4a5-e4d71bba72ac" containerID="da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c" exitCode=0 Sep 09 10:12:10.108494 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.108397 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" Sep 09 10:12:10.108494 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.108402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" event={"ID":"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac","Type":"ContainerDied","Data":"da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c"} Sep 09 10:12:10.108494 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.108457 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm" event={"ID":"dd1952cc-4b52-48d3-b4a5-e4d71bba72ac","Type":"ContainerDied","Data":"79f5dee24359649ebbc4c971a0545ef0b25679b69ccd8fde7c4f998b0eab1baa"} Sep 09 10:12:10.108494 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.108488 2578 scope.go:117] "RemoveContainer" containerID="da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c" Sep 09 10:12:10.120845 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.120821 2578 scope.go:117] "RemoveContainer" containerID="da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c" Sep 09 10:12:10.121137 ip-10-0-143-228 kubenswrapper[2578]: E0909 10:12:10.121119 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c\": container with ID starting with da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c not found: ID does not exist" containerID="da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c" Sep 09 10:12:10.121199 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.121144 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c"} err="failed to get container status \"da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c\": rpc error: code = NotFound desc = could not find container \"da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c\": container with ID starting with da8d4735559926df1d7d05a0617f2fe532e6df4ba2d4c938f7ea7697becf420c not found: ID does not exist" Sep 09 10:12:10.131207 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.131187 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm"] Sep 09 10:12:10.135264 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.135243 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-nj7tm"] Sep 09 10:12:10.183488 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:10.183463 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qgrb\" (UniqueName: \"kubernetes.io/projected/dd1952cc-4b52-48d3-b4a5-e4d71bba72ac-kube-api-access-4qgrb\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 10:12:11.127547 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:11.127513 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd1952cc-4b52-48d3-b4a5-e4d71bba72ac" path="/var/lib/kubelet/pods/dd1952cc-4b52-48d3-b4a5-e4d71bba72ac/volumes" Sep 09 10:12:14.304743 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.304713 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx"] Sep 09 10:12:14.305249 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.305094 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd1952cc-4b52-48d3-b4a5-e4d71bba72ac" containerName="manager" Sep 09 10:12:14.305249 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.305116 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd1952cc-4b52-48d3-b4a5-e4d71bba72ac" containerName="manager" Sep 09 10:12:14.305249 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.305178 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd1952cc-4b52-48d3-b4a5-e4d71bba72ac" containerName="manager" Sep 09 10:12:14.309266 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.309240 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" Sep 09 10:12:14.311951 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.311932 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 09 10:12:14.312062 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.311955 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 09 10:12:14.312912 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.312891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-kc2tn\"" Sep 09 10:12:14.317222 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.317199 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx"] Sep 09 10:12:14.414250 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.414220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5gl6\" (UniqueName: \"kubernetes.io/projected/8b927560-1046-4137-af1e-b55646cfa270-kube-api-access-x5gl6\") pod \"feast-operator-controller-manager-689b877b4b-64nxx\" (UID: \"8b927560-1046-4137-af1e-b55646cfa270\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" Sep 09 10:12:14.514597 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.514559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5gl6\" (UniqueName: \"kubernetes.io/projected/8b927560-1046-4137-af1e-b55646cfa270-kube-api-access-x5gl6\") pod \"feast-operator-controller-manager-689b877b4b-64nxx\" (UID: \"8b927560-1046-4137-af1e-b55646cfa270\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" Sep 09 10:12:14.523870 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.523846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5gl6\" (UniqueName: \"kubernetes.io/projected/8b927560-1046-4137-af1e-b55646cfa270-kube-api-access-x5gl6\") pod \"feast-operator-controller-manager-689b877b4b-64nxx\" (UID: \"8b927560-1046-4137-af1e-b55646cfa270\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" Sep 09 10:12:14.619549 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.619491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" Sep 09 10:12:14.890577 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:14.890505 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx"] Sep 09 10:12:14.893336 ip-10-0-143-228 kubenswrapper[2578]: W0909 10:12:14.893307 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b927560_1046_4137_af1e_b55646cfa270.slice/crio-ec01d0098efb4c9d5b0855e4e7b54300aa5de1d9d77228a5e7dc02eb5959a222 WatchSource:0}: Error finding container ec01d0098efb4c9d5b0855e4e7b54300aa5de1d9d77228a5e7dc02eb5959a222: Status 404 returned error can't find the container with id ec01d0098efb4c9d5b0855e4e7b54300aa5de1d9d77228a5e7dc02eb5959a222 Sep 09 10:12:15.128530 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:15.128496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" event={"ID":"8b927560-1046-4137-af1e-b55646cfa270","Type":"ContainerStarted","Data":"b47f6f15e2ae1cfe57c27976bffcf12f52d1d402780a8d4450906c1b8dff58b9"} Sep 09 10:12:15.128706 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:15.128548 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" Sep 09 10:12:15.128706 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:15.128565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" event={"ID":"8b927560-1046-4137-af1e-b55646cfa270","Type":"ContainerStarted","Data":"ec01d0098efb4c9d5b0855e4e7b54300aa5de1d9d77228a5e7dc02eb5959a222"} Sep 09 10:12:15.144158 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:15.144085 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" podStartSLOduration=1.144071098 podStartE2EDuration="1.144071098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 10:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 10:12:15.143255098 +0000 UTC m=+1756.522288263" watchObservedRunningTime="2026-09-09 10:12:15.144071098 +0000 UTC m=+1756.523104252" Sep 09 10:12:26.133126 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:26.133097 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-64nxx" Sep 09 10:12:28.654731 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:28.654696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:28.791711 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:28.791662 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:33.047575 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:33.047545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:33.148974 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:33.148947 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:33.250942 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:33.250916 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:33.362948 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:33.362913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:33.513956 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:33.513926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:12:33.791595 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:12:33.791521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:13:57.879795 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:13:57.879753 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:13:57.978607 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:13:57.978576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:13:58.187998 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:13:58.187905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:13:58.292269 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:13:58.292241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:13:58.353931 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:13:58.353905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:13:58.480093 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:13:58.480020 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:13:58.577067 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:13:58.577039 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:13:58.639256 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:13:58.639231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:15:22.549423 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:15:22.549386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:15:24.947081 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:15:24.947046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:15:28.126450 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:15:28.126415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:09.421573 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:09.421538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:09.477454 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:09.477426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:09.989477 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:09.989434 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:10.089080 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:10.089050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:10.143243 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:10.143215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:15.455977 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:15.455946 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:50.870136 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:50.870057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:50.986541 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:50.986512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:56.713228 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:56.713196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:56.821763 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:56.821723 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:57.262093 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:57.262062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:17:57.361652 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:17:57.361621 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:18:14.603161 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.603126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:18:14.723810 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.723783 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2zm4/must-gather-dpg44"] Sep 09 10:18:14.726827 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.726812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2zm4/must-gather-dpg44" Sep 09 10:18:14.729123 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.729098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2zm4\"/\"default-dockercfg-m6xl7\"" Sep 09 10:18:14.729238 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.729139 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2zm4\"/\"kube-root-ca.crt\"" Sep 09 10:18:14.729238 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.729173 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2zm4\"/\"openshift-service-ca.crt\"" Sep 09 10:18:14.736951 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.736929 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2zm4/must-gather-dpg44"] Sep 09 10:18:14.750948 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.750921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:18:14.799707 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.799667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj52m\" (UniqueName: \"kubernetes.io/projected/af675500-55d5-4700-9e96-26efb75341d7-kube-api-access-nj52m\") pod \"must-gather-dpg44\" (UID: \"af675500-55d5-4700-9e96-26efb75341d7\") " pod="openshift-must-gather-p2zm4/must-gather-dpg44" Sep 09 10:18:14.799776 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.799717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/af675500-55d5-4700-9e96-26efb75341d7-must-gather-output\") pod \"must-gather-dpg44\" (UID: \"af675500-55d5-4700-9e96-26efb75341d7\") " pod="openshift-must-gather-p2zm4/must-gather-dpg44" Sep 09 10:18:14.855074 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.854991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:18:14.900040 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.900018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj52m\" (UniqueName: \"kubernetes.io/projected/af675500-55d5-4700-9e96-26efb75341d7-kube-api-access-nj52m\") pod \"must-gather-dpg44\" (UID: \"af675500-55d5-4700-9e96-26efb75341d7\") " pod="openshift-must-gather-p2zm4/must-gather-dpg44" Sep 09 10:18:14.900127 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.900046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/af675500-55d5-4700-9e96-26efb75341d7-must-gather-output\") pod \"must-gather-dpg44\" (UID: \"af675500-55d5-4700-9e96-26efb75341d7\") " pod="openshift-must-gather-p2zm4/must-gather-dpg44" Sep 09 10:18:14.900351 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.900332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/af675500-55d5-4700-9e96-26efb75341d7-must-gather-output\") pod \"must-gather-dpg44\" (UID: \"af675500-55d5-4700-9e96-26efb75341d7\") " pod="openshift-must-gather-p2zm4/must-gather-dpg44" Sep 09 10:18:14.909545 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:14.909524 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj52m\" (UniqueName: \"kubernetes.io/projected/af675500-55d5-4700-9e96-26efb75341d7-kube-api-access-nj52m\") pod \"must-gather-dpg44\" (UID: \"af675500-55d5-4700-9e96-26efb75341d7\") " pod="openshift-must-gather-p2zm4/must-gather-dpg44" Sep 09 10:18:15.045423 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:15.045399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2zm4/must-gather-dpg44" Sep 09 10:18:15.313409 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:15.313380 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2zm4/must-gather-dpg44"] Sep 09 10:18:15.316235 ip-10-0-143-228 kubenswrapper[2578]: W0909 10:18:15.316210 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf675500_55d5_4700_9e96_26efb75341d7.slice/crio-a74fe35f081a6d3376d1cf8d66a6bd3f34d69e332d870c42cb9c1ef66bcc5e06 WatchSource:0}: Error finding container a74fe35f081a6d3376d1cf8d66a6bd3f34d69e332d870c42cb9c1ef66bcc5e06: Status 404 returned error can't find the container with id a74fe35f081a6d3376d1cf8d66a6bd3f34d69e332d870c42cb9c1ef66bcc5e06 Sep 09 10:18:15.318059 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:15.318044 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 10:18:15.357620 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:15.357595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2zm4/must-gather-dpg44" event={"ID":"af675500-55d5-4700-9e96-26efb75341d7","Type":"ContainerStarted","Data":"a74fe35f081a6d3376d1cf8d66a6bd3f34d69e332d870c42cb9c1ef66bcc5e06"} Sep 09 10:18:16.366805 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:16.366759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2zm4/must-gather-dpg44" event={"ID":"af675500-55d5-4700-9e96-26efb75341d7","Type":"ContainerStarted","Data":"f96fb7debe9a2948043cc4653a38d4ed270e51ed452fc59260125da9ca345b66"} Sep 09 10:18:16.367248 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:16.367150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2zm4/must-gather-dpg44" event={"ID":"af675500-55d5-4700-9e96-26efb75341d7","Type":"ContainerStarted","Data":"de8394ac0c102794af3a321f5f471d5b00ed5024bb5e8c3993e5807119ffafaa"} Sep 09 10:18:16.383957 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:16.383913 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2zm4/must-gather-dpg44" podStartSLOduration=1.558220366 podStartE2EDuration="2.3838964s" totalImagesPullingTime="825.676034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 10:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 10:18:16.383241921 +0000 UTC m=+2117.762275082" watchObservedRunningTime="2026-09-09 10:18:16.3838964 +0000 UTC m=+2117.762929555" Sep 09 10:18:17.526779 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:17.526749 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fqn8r_9b3764ca-d808-4095-be9a-b4fd91464d36/global-pull-secret-syncer/0.log" Sep 09 10:18:17.576178 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:17.576146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" Sep 09 10:18:17.720356 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:17.720313 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-228.ec2.internal_728b04a33548859b274bbec2cc5b3fee/haproxy/0.log" Sep 09 10:18:20.103728 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:20.103694 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:18:20.164522 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:20.164489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9jszf_41645d37-fbb5-44c9-8ba5-6b4cc17ecddc/konnectivity-agent/0.log" limit=1024 Sep 09 10:18:21.530354 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:21.530236 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-848656fc4c-jh4pw_599fb9ac-8161-437b-a818-f0f4deb56b80/metrics-server/0.log" Sep 09 10:18:21.560892 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:21.560797 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-c9swq_eb9836da-175a-4bbc-b49d-a7d5e26e7666/monitoring-plugin/0.log" Sep 09 10:18:21.693033 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:21.692940 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dkmdw_ccb47908-7d88-4839-9b60-e75aeeeef7c5/node-exporter/0.log" Sep 09 10:18:21.716842 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:21.716817 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dkmdw_ccb47908-7d88-4839-9b60-e75aeeeef7c5/kube-rbac-proxy/0.log" Sep 09 10:18:21.739932 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:21.739903 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dkmdw_ccb47908-7d88-4839-9b60-e75aeeeef7c5/init-textfile/0.log" Sep 09 10:18:22.143184 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:22.143136 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-sztkt_22da5b42-96de-4b37-b505-e6316332006e/prometheus-operator/0.log" Sep 09 10:18:22.168410 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:22.168365 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-sztkt_22da5b42-96de-4b37-b505-e6316332006e/kube-rbac-proxy/0.log" Sep 09 10:18:24.973602 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:24.973559 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd"] Sep 09 10:18:24.979442 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:24.979414 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:24.995269 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:24.995245 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd"] Sep 09 10:18:25.091378 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.091280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-proc\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.091378 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.091335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-lib-modules\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.091614 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.091439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-podres\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.091614 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.091487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrg4z\" (UniqueName: \"kubernetes.io/projected/f154d2e6-a963-4d94-a3ac-5106b481fb9e-kube-api-access-qrg4z\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.091614 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.091520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-sys\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.184245 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.184217 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-l7z6r_dc19dd90-391d-49f2-b55d-5730c9ce9382/volume-data-source-validator/0.log" Sep 09 10:18:25.192808 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.192778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-podres\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.193054 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.193035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrg4z\" (UniqueName: \"kubernetes.io/projected/f154d2e6-a963-4d94-a3ac-5106b481fb9e-kube-api-access-qrg4z\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.193232 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.193204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-sys\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.193898 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.193074 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-podres\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.193898 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.193891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-proc\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.194046 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.193384 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-sys\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.194046 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.193917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-lib-modules\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.194046 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.193992 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-lib-modules\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.194046 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.193994 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f154d2e6-a963-4d94-a3ac-5106b481fb9e-proc\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.201787 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.201759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrg4z\" (UniqueName: \"kubernetes.io/projected/f154d2e6-a963-4d94-a3ac-5106b481fb9e-kube-api-access-qrg4z\") pod \"perf-node-gather-daemonset-f6gbd\" (UID: \"f154d2e6-a963-4d94-a3ac-5106b481fb9e\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.290603 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.290529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:25.577224 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:25.577187 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd"] Sep 09 10:18:25.580666 ip-10-0-143-228 kubenswrapper[2578]: W0909 10:18:25.580640 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf154d2e6_a963_4d94_a3ac_5106b481fb9e.slice/crio-def29718ec7cdd64bc19cdd3f6de5f7b9d923408524f7983bc4beec3a74640ab WatchSource:0}: Error finding container def29718ec7cdd64bc19cdd3f6de5f7b9d923408524f7983bc4beec3a74640ab: Status 404 returned error can't find the container with id def29718ec7cdd64bc19cdd3f6de5f7b9d923408524f7983bc4beec3a74640ab Sep 09 10:18:26.416795 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:26.416757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" event={"ID":"f154d2e6-a963-4d94-a3ac-5106b481fb9e","Type":"ContainerStarted","Data":"b1cceead9485c838141d8fdab63268464f132d0e96188cb524f3c7bce7f667ec"} Sep 09 10:18:26.417179 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:26.416806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" event={"ID":"f154d2e6-a963-4d94-a3ac-5106b481fb9e","Type":"ContainerStarted","Data":"def29718ec7cdd64bc19cdd3f6de5f7b9d923408524f7983bc4beec3a74640ab"} Sep 09 10:18:26.417179 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:26.416877 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:26.447568 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:26.447523 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" podStartSLOduration=2.44750828 podStartE2EDuration="2.44750828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 10:18:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 10:18:26.445790009 +0000 UTC m=+2127.824823182" watchObservedRunningTime="2026-09-09 10:18:26.44750828 +0000 UTC m=+2127.826541434" Sep 09 10:18:26.489334 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:26.489312 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wgslx_4548e955-dc4a-4933-a001-59047b181ea1/dns/0.log" Sep 09 10:18:26.522662 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:26.522636 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wgslx_4548e955-dc4a-4933-a001-59047b181ea1/kube-rbac-proxy/0.log" Sep 09 10:18:26.606902 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:26.606870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s8b84_7368ba37-5e70-4a5b-b7dc-b7b825f0506a/dns-node-resolver/0.log" Sep 09 10:18:27.013608 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:27.013574 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-685bc57656-7d9nz_e6b944e0-a241-4983-931e-1a5ea3bf98bc/registry/0.log" Sep 09 10:18:27.082699 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:27.082657 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vxccb_269a7999-e486-4a0f-bfc5-4bc9265dbbb1/node-ca/0.log" Sep 09 10:18:27.774416 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:27.774380 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cd4f4984d-2fqzd_9bda6aec-fad4-467e-943f-8bf95be3784c/router/0.log" Sep 09 10:18:28.117540 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:28.117512 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r55m5_4dc29d55-4502-44b6-b15e-13bca7c9e4e0/serve-healthcheck-canary/0.log" Sep 09 10:18:28.513425 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:28.513353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2msmf_cf9a2eee-bf5e-495a-9cd5-8fc8902a0310/kube-rbac-proxy/0.log" Sep 09 10:18:28.533765 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:28.533732 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2msmf_cf9a2eee-bf5e-495a-9cd5-8fc8902a0310/exporter/0.log" Sep 09 10:18:28.556553 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:28.556531 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2msmf_cf9a2eee-bf5e-495a-9cd5-8fc8902a0310/extractor/0.log" Sep 09 10:18:32.434184 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:32.434149 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-f6gbd" Sep 09 10:18:33.022421 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:33.022377 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-4zj5b_575ef0e1-b900-4149-9c9a-e58f5efece73/kube-storage-version-migrator-operator/1.log" Sep 09 10:18:33.023424 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:33.023398 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-4zj5b_575ef0e1-b900-4149-9c9a-e58f5efece73/kube-storage-version-migrator-operator/0.log" Sep 09 10:18:34.124290 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.124216 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6sfs_1606604c-8f1c-45e7-9350-0cbcbed9c931/kube-multus-additional-cni-plugins/0.log" Sep 09 10:18:34.147644 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.147515 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6sfs_1606604c-8f1c-45e7-9350-0cbcbed9c931/egress-router-binary-copy/0.log" Sep 09 10:18:34.172359 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.172330 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6sfs_1606604c-8f1c-45e7-9350-0cbcbed9c931/cni-plugins/0.log" Sep 09 10:18:34.195620 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.195591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6sfs_1606604c-8f1c-45e7-9350-0cbcbed9c931/bond-cni-plugin/0.log" Sep 09 10:18:34.218371 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.218343 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6sfs_1606604c-8f1c-45e7-9350-0cbcbed9c931/routeoverride-cni/0.log" Sep 09 10:18:34.241968 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.241925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6sfs_1606604c-8f1c-45e7-9350-0cbcbed9c931/whereabouts-cni-bincopy/0.log" Sep 09 10:18:34.264409 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.264388 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6sfs_1606604c-8f1c-45e7-9350-0cbcbed9c931/whereabouts-cni/0.log" Sep 09 10:18:34.462846 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.462814 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bzpqw_6a4e5afb-d9be-4150-9620-64453bb7c048/kube-multus/0.log" Sep 09 10:18:34.555977 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.555947 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g26bw_d9f10052-2bb2-49e8-a943-46101a17508c/network-metrics-daemon/0.log" Sep 09 10:18:34.578505 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:34.578476 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g26bw_d9f10052-2bb2-49e8-a943-46101a17508c/kube-rbac-proxy/0.log" Sep 09 10:18:35.685798 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:35.685766 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbpcq_a66177ba-7509-4511-985b-d0c6c8734c78/ovn-controller/0.log" Sep 09 10:18:35.701842 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:35.701768 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbpcq_a66177ba-7509-4511-985b-d0c6c8734c78/ovn-acl-logging/0.log" Sep 09 10:18:35.729188 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:35.729161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbpcq_a66177ba-7509-4511-985b-d0c6c8734c78/kube-rbac-proxy-node/0.log" Sep 09 10:18:35.754962 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:35.754929 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbpcq_a66177ba-7509-4511-985b-d0c6c8734c78/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 10:18:35.774590 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:35.774557 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbpcq_a66177ba-7509-4511-985b-d0c6c8734c78/northd/0.log" Sep 09 10:18:35.794896 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:35.794873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbpcq_a66177ba-7509-4511-985b-d0c6c8734c78/nbdb/0.log" Sep 09 10:18:35.814597 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:35.814574 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbpcq_a66177ba-7509-4511-985b-d0c6c8734c78/sbdb/0.log" Sep 09 10:18:35.856011 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:35.855975 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sbpcq_a66177ba-7509-4511-985b-d0c6c8734c78/ovnkube-controller/0.log" Sep 09 10:18:36.834924 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:36.834891 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dp8t9_791d38b1-bef1-4dcc-b291-094e971360d4/network-check-target-container/0.log" Sep 09 10:18:37.809441 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:37.809414 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-mcr6f_324840fe-3788-427b-889a-c24c0050fbe7/iptables-alerter/0.log" Sep 09 10:18:38.514460 ip-10-0-143-228 kubenswrapper[2578]: I0909 10:18:38.514424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zdmm8_0cfe0ee4-93b6-4254-94f4-9d8fbdffffbb/tuned/0.log"