Sep 07 12:32:41.989918 ip-10-0-128-213 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 12:32:41.989930 ip-10-0-128-213 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 12:32:41.989940 ip-10-0-128-213 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 12:32:41.990249 ip-10-0-128-213 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 12:32:51.332951 ip-10-0-128-213 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Sep 07 12:32:51.332965 ip-10-0-128-213 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fd67594f6123405e85f3e57f562c7b5c -- Sep 07 12:34:26.366997 ip-10-0-128-213 systemd[1]: Starting Kubernetes Kubelet... Sep 07 12:34:26.787854 ip-10-0-128-213 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:34:26.787854 ip-10-0-128-213 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 12:34:26.787854 ip-10-0-128-213 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:34:26.787854 ip-10-0-128-213 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 12:34:26.787854 ip-10-0-128-213 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:34:26.789906 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.789820 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 12:34:26.793993 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.793977 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:26.793993 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.793993 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.793997 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794000 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794004 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794008 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794011 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794014 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794017 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794020 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794023 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794026 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794028 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794031 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794036 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794040 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794043 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794046 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794049 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794053 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:26.794064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794056 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794059 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794062 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794065 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794068 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794071 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794074 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794077 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794080 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794083 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794085 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794089 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794093 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794096 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794099 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794102 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794105 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794107 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794110 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794112 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:26.794523 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794115 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794118 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794120 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794123 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794127 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794129 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794132 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794135 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794138 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794140 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794143 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794147 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794150 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794153 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794157 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794161 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794164 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794167 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794170 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:26.795029 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794173 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794176 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794179 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794181 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794184 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794187 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794190 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794192 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794195 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794197 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794200 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794203 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794207 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794210 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794212 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794215 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794217 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794220 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794223 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794225 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:26.795511 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794228 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794230 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794233 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794236 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794239 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794241 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794244 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794247 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794250 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794253 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794255 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794258 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794260 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794263 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794266 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794268 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794271 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794274 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794276 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.794279 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:26.796048 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795892 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795900 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795904 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795907 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795910 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795914 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795917 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795920 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795923 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795926 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795930 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795934 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795937 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795940 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795943 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795945 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795949 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795953 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795957 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:26.796547 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795960 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795964 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795967 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795970 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795973 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795976 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795978 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795981 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795984 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795988 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795992 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795995 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.795997 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796000 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796002 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796005 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796007 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796010 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796013 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796016 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:26.797042 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796019 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796021 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796024 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796026 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796029 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796032 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796034 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796037 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796039 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796042 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796045 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796048 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796051 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796054 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796057 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796060 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796063 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796066 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796068 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:26.797545 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796071 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796073 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796076 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796079 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796081 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796084 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796086 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796090 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796092 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796095 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796097 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796100 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796102 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796105 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796108 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796110 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796113 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796116 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796118 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796121 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:26.798037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796123 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796126 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796130 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796133 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796136 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796139 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796142 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796145 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796147 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796150 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796153 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796156 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796159 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796162 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796164 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796167 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796169 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796172 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796174 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796177 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:26.798531 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796180 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796553 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796558 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796561 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796564 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796567 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796570 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796573 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796575 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796580 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796584 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796587 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796590 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796592 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796595 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796598 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796615 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796618 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796621 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796624 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:26.799054 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796626 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796629 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796632 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796635 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796638 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796641 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796644 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796646 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796649 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796652 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796654 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796657 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796659 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796662 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796665 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796667 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796670 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796672 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796676 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796678 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:26.799549 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796681 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796683 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796686 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796689 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796691 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796694 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796698 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796700 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796703 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796706 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796709 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796711 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796714 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796717 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796719 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796722 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796724 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796727 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796729 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:26.800064 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796732 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796734 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796737 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796740 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796742 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796745 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796747 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796750 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796753 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796755 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796758 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796761 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796765 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796767 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796770 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796774 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796778 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796781 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796783 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:26.800530 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796787 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796789 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796792 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796795 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796798 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796801 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796804 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796807 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796809 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796812 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796815 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796818 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796821 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796823 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796825 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796828 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796831 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796833 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796836 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796839 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:26.801077 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796842 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.796845 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796916 2558 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796952 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796959 2558 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796964 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796969 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796972 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796977 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796981 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796984 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796987 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796991 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796995 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.796998 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797005 2558 flags.go:64] FLAG: --cgroup-root="" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797008 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797012 2558 flags.go:64] FLAG: --client-ca-file="" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797015 2558 flags.go:64] FLAG: --cloud-provider="external" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797025 2558 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797030 2558 flags.go:64] FLAG: --cluster-domain="" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797033 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797036 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797040 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 12:34:26.801563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797044 2558 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797048 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797051 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797054 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797058 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797061 2558 flags.go:64] FLAG: --contention-profiling="false" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797064 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797067 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797070 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797073 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797077 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797080 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797083 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797086 2558 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797089 2558 flags.go:64] FLAG: --enable-server="true" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797093 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797098 2558 flags.go:64] FLAG: --event-burst="100" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797101 2558 flags.go:64] FLAG: --event-qps="50" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797104 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797107 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797110 2558 flags.go:64] FLAG: --eviction-hard="" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797114 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797117 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797121 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797124 2558 flags.go:64] FLAG: --eviction-soft="" Sep 07 12:34:26.802170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797127 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797130 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797133 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797136 2558 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797139 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797142 2558 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797146 2558 flags.go:64] FLAG: --feature-gates="" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797149 2558 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797153 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797156 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797159 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797162 2558 flags.go:64] FLAG: --healthz-port="10248" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797165 2558 flags.go:64] FLAG: --help="false" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797168 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-128-213.ec2.internal" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797171 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797174 2558 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797177 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797180 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797185 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797188 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797191 2558 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797194 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797197 2558 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 12:34:26.802821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797200 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797204 2558 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797207 2558 flags.go:64] FLAG: --kube-reserved="" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797210 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797213 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797216 2558 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797219 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797223 2558 flags.go:64] FLAG: --lock-file="" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797226 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797229 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797232 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797237 2558 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797240 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797243 2558 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797246 2558 flags.go:64] FLAG: --logging-format="text" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797249 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797252 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797255 2558 flags.go:64] FLAG: --manifest-url="" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797258 2558 flags.go:64] FLAG: --manifest-url-header="" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797262 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797265 2558 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797269 2558 flags.go:64] FLAG: --max-pods="110" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797272 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797275 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797278 2558 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 12:34:26.803447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797281 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797285 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797289 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797292 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797299 2558 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797302 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797305 2558 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797308 2558 flags.go:64] FLAG: --pod-cidr="" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797311 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797317 2558 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797320 2558 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797323 2558 flags.go:64] FLAG: --pods-per-core="0" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797326 2558 flags.go:64] FLAG: --port="10250" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797329 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797332 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e6a600faf8f4e03d" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797337 2558 flags.go:64] FLAG: --qos-reserved="" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797340 2558 flags.go:64] FLAG: --read-only-port="10255" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797343 2558 flags.go:64] FLAG: --register-node="true" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797347 2558 flags.go:64] FLAG: --register-with-taints="" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797350 2558 flags.go:64] FLAG: --registry-burst="10" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797353 2558 flags.go:64] FLAG: --registry-qps="5" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797356 2558 flags.go:64] FLAG: --reserved-cpus="" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797359 2558 flags.go:64] FLAG: --reserved-memory="" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797363 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797366 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 12:34:26.804086 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797369 2558 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797372 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797374 2558 flags.go:64] FLAG: --runonce="false" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797377 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797381 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797384 2558 flags.go:64] FLAG: --seccomp-default="false" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797386 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797389 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797393 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797397 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797401 2558 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797403 2558 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797406 2558 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797409 2558 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797412 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797415 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797418 2558 flags.go:64] FLAG: --system-cgroups="" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797421 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797427 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797429 2558 flags.go:64] FLAG: --tls-cert-file="" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797432 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797436 2558 flags.go:64] FLAG: --tls-min-version="" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797440 2558 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797443 2558 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797446 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 12:34:26.804772 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797449 2558 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797452 2558 flags.go:64] FLAG: --v="2" Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797456 2558 flags.go:64] FLAG: --version="false" Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797460 2558 flags.go:64] FLAG: --vmodule="" Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797464 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.797467 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797577 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797581 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797584 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797588 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797590 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797593 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797596 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797611 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797614 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797617 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797622 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797625 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797627 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797630 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797633 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:26.805425 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797636 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797639 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797642 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797645 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797648 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797651 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797653 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797656 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797659 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797662 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797664 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797667 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797671 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797675 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797677 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797680 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797683 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797686 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797688 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:26.805984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797691 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797694 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797696 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797699 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797702 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797705 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797707 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797710 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797714 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797716 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797719 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797722 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797724 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797727 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797730 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797732 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797735 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797738 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797740 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797743 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:26.806460 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797745 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797748 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797751 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797754 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797756 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797759 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797761 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797764 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797766 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797770 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797773 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797776 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797779 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797781 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797784 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797787 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797789 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797792 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797794 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797797 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:26.806971 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797801 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797803 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797806 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797808 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797811 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797814 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797816 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797819 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797821 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797824 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797827 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797829 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797832 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797835 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797839 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797842 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797845 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797848 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797851 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797854 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:26.807461 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797857 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797860 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797863 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797865 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.797868 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.798596 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.806684 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.806703 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.807665 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.807676 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807743 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807748 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807752 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807755 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:26.808017 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807758 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807760 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807763 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807766 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807768 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807772 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807777 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807779 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807782 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807784 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807787 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807790 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807792 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807795 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807797 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807800 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807802 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807805 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807808 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:26.808379 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807810 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807813 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807815 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807817 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807820 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807822 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807832 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807835 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807837 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807840 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807843 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807845 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807848 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807850 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807853 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807855 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807857 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807860 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807862 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807865 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:26.808866 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807867 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807870 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807872 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807875 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807877 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807880 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807883 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807886 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807889 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807891 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807893 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807896 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807898 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807901 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807903 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807906 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807908 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807911 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807914 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807925 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:26.809358 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807928 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807931 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807934 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807936 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807939 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807942 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807946 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807949 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807952 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807955 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807958 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807960 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807963 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807966 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807968 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807971 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807973 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807975 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807978 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807980 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:26.809926 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807983 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807986 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807988 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807991 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807993 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807996 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.807998 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808000 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808003 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808006 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808009 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808011 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808021 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808025 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808029 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:26.810418 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808032 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.808037 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808186 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808195 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808198 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808201 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808204 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808206 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808209 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808212 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808214 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808217 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808220 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808222 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808225 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:26.810805 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808228 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808230 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808232 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808235 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808238 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808241 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808243 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808246 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808248 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808251 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808253 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808256 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808259 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808262 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808264 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808273 2558 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808276 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808278 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808280 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808283 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:26.811169 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808285 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808288 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808290 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808293 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808296 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808300 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808303 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808305 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808307 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808310 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808312 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808315 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808317 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808320 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808322 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808325 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808327 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808330 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808334 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:26.811704 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808337 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808340 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808342 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808346 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808348 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808352 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808354 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808357 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808360 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808369 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808372 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808375 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808377 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808380 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808383 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808386 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808390 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808393 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808396 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:26.812177 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808399 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808401 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808404 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808406 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808409 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808412 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808414 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808417 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808419 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808422 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808424 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808427 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808429 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808432 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808434 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808437 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808439 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808442 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808445 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808448 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:26.812874 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808450 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808453 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808456 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808464 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808467 2558 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808469 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808472 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:26.808474 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.808479 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.808643 2558 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.811117 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.812276 2558 server.go:1019] "Starting client certificate rotation" Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.812391 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 12:34:26.813700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.812510 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 12:34:26.815203 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.815187 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 12:34:26.821309 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.821278 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 12:34:26.833757 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.833738 2558 log.go:25] "Validated CRI v1 runtime API" Sep 07 12:34:26.837617 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.837588 2558 log.go:25] "Validated CRI v1 image API" Sep 07 12:34:26.839802 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.839773 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 12:34:26.842400 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.842382 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8355cc32-7a75-4a26-b53f-864bcd38d93a:/dev/nvme0n1p4 fd9b91c4-0ed5-4e0b-8c32-bc7060b7a854:/dev/nvme0n1p3] Sep 07 12:34:26.842469 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.842399 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 12:34:26.847577 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.847461 2558 manager.go:216] Machine: {Timestamp:2026-09-07 12:34:26.846029633 +0000 UTC m=+0.371351948 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110167 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b882b808d84f662ea66ed44bb6a4e SystemUUID:ec2b882b-808d-84f6-62ea-66ed44bb6a4e BootID:fd67594f-6123-405e-85f3-e57f562c7b5c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:38:fc:73:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:38:fc:73:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:93:00:dc:29:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 12:34:26.847577 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.847567 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 12:34:26.847720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.847663 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 12:34:26.850712 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.850696 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 12:34:26.850768 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.850706 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 12:34:26.850893 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.850741 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 12:34:26.851724 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.851713 2558 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 12:34:26.851764 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.851727 2558 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 12:34:26.851764 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.851735 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 12:34:26.852433 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.852424 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 12:34:26.853699 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.853688 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 12:34:26.858431 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.858420 2558 state_mem.go:36] "Initialized new in-memory state store" Sep 07 12:34:26.858550 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.858541 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 12:34:26.858586 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.858572 2558 kubelet.go:486] "Attempting to sync node with API server" Sep 07 12:34:26.858633 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.858589 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 12:34:26.858633 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.858615 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 12:34:26.858700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.858666 2558 kubelet.go:398] "Adding apiserver pod source" Sep 07 12:34:26.858700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.858681 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 12:34:26.859142 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.859121 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 12:34:26.859254 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.859155 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 12:34:26.861717 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.861686 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 12:34:26.864947 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.864927 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 12:34:26.865050 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.864969 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 12:34:26.866540 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866527 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 12:34:26.866624 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866548 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 12:34:26.866624 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866557 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 12:34:26.866624 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866565 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 12:34:26.866624 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866578 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 12:34:26.866624 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866586 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 12:34:26.866624 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866620 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 12:34:26.866846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866629 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 12:34:26.866846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866644 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 12:34:26.866846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866653 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 12:34:26.866846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866670 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 12:34:26.866846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.866678 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 12:34:26.868421 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.868408 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 12:34:26.868487 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.868424 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 12:34:26.869566 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.869541 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 12:34:26.869647 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.869565 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 12:34:26.872461 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.872448 2558 server.go:1268] "Started kubelet" Sep 07 12:34:26.872538 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.872512 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 12:34:26.877013 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.876932 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 12:34:26.877090 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.877081 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 12:34:26.877644 ip-10-0-128-213 systemd[1]: Started Kubernetes Kubelet. Sep 07 12:34:26.880740 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.880383 2558 server.go:310] "Adding debug handlers to kubelet server" Sep 07 12:34:26.881036 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.881006 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 12:34:26.883674 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.883657 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 12:34:26.884134 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.884119 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 12:34:26.885240 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.884185 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-213.ec2.internal.18d309fec7aac2b8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-213.ec2.internal,UID:ip-10-0-128-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-213.ec2.internal,},FirstTimestamp:2026-09-07 12:34:26.872419 +0000 UTC m=+0.397741295,LastTimestamp:2026-09-07 12:34:26.872419 +0000 UTC m=+0.397741295,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-213.ec2.internal,}" Sep 07 12:34:26.887872 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.887848 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 12:34:26.888563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.888547 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 12:34:26.888873 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.888843 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:26.889310 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889289 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 12:34:26.889310 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889303 2558 factory.go:55] Registering systemd factory Sep 07 12:34:26.889453 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889320 2558 factory.go:223] Registration of the systemd container factory successfully Sep 07 12:34:26.889453 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889292 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 12:34:26.889453 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889375 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 12:34:26.889558 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889502 2558 reconstruct.go:97] "Volume reconstruction finished" Sep 07 12:34:26.889558 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889511 2558 reconciler.go:29] "Reconciler: start to sync state" Sep 07 12:34:26.889558 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889544 2558 factory.go:153] Registering CRI-O factory Sep 07 12:34:26.889558 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889559 2558 factory.go:223] Registration of the crio container factory successfully Sep 07 12:34:26.889690 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889629 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 12:34:26.889690 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889650 2558 factory.go:103] Registering Raw factory Sep 07 12:34:26.889690 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.889666 2558 manager.go:1196] Started watching for new ooms in manager Sep 07 12:34:26.890146 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.890132 2558 manager.go:349] Starting recovery of all containers Sep 07 12:34:26.890303 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.890262 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 12:34:26.890469 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.890443 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 12:34:26.901266 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.901139 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dp49d" Sep 07 12:34:26.901266 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.901212 2558 manager.go:354] Recovery completed Sep 07 12:34:26.906106 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.906092 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:26.908249 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.908232 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dp49d" Sep 07 12:34:26.908703 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.908687 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:26.908788 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.908719 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:26.908788 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.908732 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:26.909525 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.909458 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 12:34:26.909525 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.909472 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 12:34:26.909525 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.909476 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:26.909525 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.909492 2558 state_mem.go:36] "Initialized new in-memory state store" Sep 07 12:34:26.911268 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.911248 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:26.911350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.911280 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:26.911350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.911290 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:26.911957 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.911941 2558 policy_none.go:49] "None policy: Start" Sep 07 12:34:26.912012 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.911959 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 12:34:26.912012 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.911973 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 12:34:26.914278 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.914267 2558 policy_none.go:47] "Start" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.943078 2558 manager.go:337] "Starting Device Plugin manager" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.943111 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.943123 2558 server.go:87] "Starting device plugin registration server" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.943365 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.943378 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.943542 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.943631 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.943642 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.944188 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 12:34:26.964726 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.944239 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:26.981964 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.981938 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 12:34:26.983104 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.983085 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 12:34:26.983240 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.983141 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 12:34:26.983240 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.983165 2558 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 12:34:26.983346 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:26.983249 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 12:34:26.985906 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:26.985883 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:27.044394 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.044325 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:27.045379 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.045361 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:27.045463 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.045400 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:27.045463 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.045417 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:27.045463 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.045445 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.052638 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.052623 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.052692 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:27.052644 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-213.ec2.internal\": node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:27.079849 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:27.079823 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:27.083866 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.083846 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal"] Sep 07 12:34:27.083927 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.083917 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:27.085292 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.085277 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:27.085370 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.085305 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:27.085370 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.085317 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:27.087500 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.087488 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:27.087655 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.087642 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.087720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.087669 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:27.088181 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.088158 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:27.088277 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.088186 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:27.088277 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.088198 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:27.088277 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.088211 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:27.088277 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.088234 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:27.088277 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.088248 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:27.090334 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.090319 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.090421 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.090349 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:27.090421 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.090343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c32b47062b68759893f0dbb8cc31abb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"2c32b47062b68759893f0dbb8cc31abb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.090421 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.090403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ed4608990e828571d9e6032ee57e26d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"6ed4608990e828571d9e6032ee57e26d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.090553 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.090430 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c32b47062b68759893f0dbb8cc31abb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"2c32b47062b68759893f0dbb8cc31abb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.091001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.090986 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:27.091073 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.091016 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:27.091073 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.091032 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:27.118147 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:27.118125 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-213.ec2.internal\" not found" node="ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.122435 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:27.122417 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-213.ec2.internal\" not found" node="ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.180807 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:27.180785 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:27.190576 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.190494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ed4608990e828571d9e6032ee57e26d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"6ed4608990e828571d9e6032ee57e26d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.190576 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.190558 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6ed4608990e828571d9e6032ee57e26d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"6ed4608990e828571d9e6032ee57e26d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.190681 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.190614 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c32b47062b68759893f0dbb8cc31abb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"2c32b47062b68759893f0dbb8cc31abb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.190681 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.190649 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c32b47062b68759893f0dbb8cc31abb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"2c32b47062b68759893f0dbb8cc31abb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.190681 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.190661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c32b47062b68759893f0dbb8cc31abb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"2c32b47062b68759893f0dbb8cc31abb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.190774 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.190690 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c32b47062b68759893f0dbb8cc31abb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"2c32b47062b68759893f0dbb8cc31abb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.281720 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:27.281687 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:27.382518 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:27.382445 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:27.420898 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.420869 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.425857 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:27.425721 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Sep 07 12:34:27.483475 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:27.483432 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:29.183879 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.183842 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:29.284512 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.284386 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:29.384948 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.384892 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Sep 07 12:34:29.388394 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.388375 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:29.388993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.388559 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Sep 07 12:34:29.401543 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.401524 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 12:34:29.402949 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.402936 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Sep 07 12:34:29.411673 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.411659 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 12:34:29.411848 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.411796 2558 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.128.213:52934->44.220.14.216:6443: use of closed network connection" Sep 07 12:34:29.411887 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.411877 2558 kubelet.go:3250] "Failed creating a mirror pod" err="unexpected error when reading response body. Please retry. Original error: read tcp 10.0.128.213:52934->44.220.14.216:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Sep 07 12:34:29.411922 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.411801 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 12:34:29.411922 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.411801 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 12:34:29.449837 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.449810 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:29.459600 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.459580 2558 apiserver.go:52] "Watching apiserver" Sep 07 12:34:29.466887 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.466869 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 12:34:29.469380 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.469349 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-mwmpw","openshift-dns/node-resolver-lm4z6","openshift-multus/multus-xclkq","openshift-multus/network-metrics-daemon-p8mnv","kube-system/global-pull-secret-syncer-5zjc4","kube-system/konnectivity-agent-9clw7","openshift-image-registry/node-ca-lnp54","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal","openshift-multus/multus-additional-cni-plugins-cjqkf","openshift-network-diagnostics/network-check-target-9zw99","openshift-network-operator/iptables-alerter-mvhcz","openshift-ovn-kubernetes/ovnkube-node-b7xfc","kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h"] Sep 07 12:34:29.471993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.471972 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.474220 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.474199 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.474319 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.474247 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bkjlt\"" Sep 07 12:34:29.474319 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.474247 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 12:34:29.474423 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.474399 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 12:34:29.474715 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.474702 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 12:34:29.476254 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.476236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.476472 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.476242 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 12:34:29.476644 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.476625 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 12:34:29.477010 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.476991 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 12:34:29.477120 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.477046 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 12:34:29.477998 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.477981 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 12:34:29.477998 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.477996 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 12:34:29.478129 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.478002 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 12:34:29.478129 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.478008 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-92gr2\"" Sep 07 12:34:29.478478 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.478458 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 12:34:29.478478 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.478468 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 12:34:29.478640 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.478543 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:29.478640 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.478618 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:29.478752 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.478628 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 12:34:29.478752 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.478680 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dwkps\"" Sep 07 12:34:29.480669 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.480654 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.482609 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.482594 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:34:29.482690 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.482642 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 12:34:29.482838 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.482823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:29.482941 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.482825 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gcg9c\"" Sep 07 12:34:29.484833 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.484818 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 12:34:29.484897 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.484834 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mg9jk\"" Sep 07 12:34:29.484897 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.484883 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 12:34:29.485000 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.484985 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.486853 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.486834 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 12:34:29.486853 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.486847 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-grs8g\"" Sep 07 12:34:29.487054 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.487042 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 12:34:29.487253 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.487240 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.487880 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.487867 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 12:34:29.489379 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.489359 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.489445 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.489433 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 12:34:29.489734 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.489692 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xc9v7\"" Sep 07 12:34:29.489844 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.489754 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 12:34:29.489844 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.489773 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 12:34:29.491640 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.491616 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:29.491734 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.491653 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 12:34:29.491734 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.491680 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:29.491734 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.491698 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 12:34:29.491734 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.491703 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j6hmw\"" Sep 07 12:34:29.494137 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.494121 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.495456 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-var-lib-kubelet\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.495557 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:29.495557 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495514 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-etc-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.495557 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovnkube-config\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.495671 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-netns\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.495671 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-multus-certs\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.495671 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495604 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7535637d-a3cc-40d0-aec7-fdecedf5ef72-konnectivity-ca\") pod \"konnectivity-agent-9clw7\" (UID: \"7535637d-a3cc-40d0-aec7-fdecedf5ef72\") " pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:29.495671 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-var-lib-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.495671 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495663 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-ovn\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.495824 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495712 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-log-socket\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.495824 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzxvf\" (UniqueName: \"kubernetes.io/projected/028404bc-6452-4d60-8962-cd8f899f8fdf-kube-api-access-qzxvf\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.495824 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495767 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-sys-fs\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.495824 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.495824 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495803 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-device-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.495977 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gx7t\" (UniqueName: \"kubernetes.io/projected/5e722016-4e1c-4cd0-80cb-19d044cc821e-kube-api-access-6gx7t\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:29.495977 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495848 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysctl-conf\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.495977 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495867 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-systemd\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.495977 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.495977 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-system-cni-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.496137 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.495975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-cnibin\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.496137 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.496008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-conf-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.496137 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.496033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.496846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-lib-modules\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.496891 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.496917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r54rt\" (UniqueName: \"kubernetes.io/projected/560e36eb-1307-4281-8d72-48e17f8f5182-kube-api-access-r54rt\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.496923 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.496947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-system-cni-dir\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.496988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-cnibin\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497032 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7zvq4\"" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497185 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.497032 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:29.497324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497213 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-registration-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497471 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqdwf\" (UniqueName: \"kubernetes.io/projected/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-kube-api-access-hqdwf\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea852cfd-9f11-41eb-9526-90abd8e907b2-serviceca\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497587 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef377deb-47f7-4251-b74c-d3e770cdc31a-hosts-file\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovnkube-script-lib\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-socket-dir-parent\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497678 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-cni-multus\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497724 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7535637d-a3cc-40d0-aec7-fdecedf5ef72-agent-certs\") pod \"konnectivity-agent-9clw7\" (UID: \"7535637d-a3cc-40d0-aec7-fdecedf5ef72\") " pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.497846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-cni-netd\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea852cfd-9f11-41eb-9526-90abd8e907b2-host\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysconfig\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.497944 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef377deb-47f7-4251-b74c-d3e770cdc31a-tmp-dir\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498004 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-systemd-units\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-run-netns\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-cni-bin\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498114 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbg7n\" (UniqueName: \"kubernetes.io/projected/ea852cfd-9f11-41eb-9526-90abd8e907b2-kube-api-access-kbg7n\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-kubernetes\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysctl-d\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498216 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-run\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-host\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-slash\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498302 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06780cd0-e441-458b-b371-d13377d92f6c-cni-binary-copy\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498328 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-modprobe-d\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.498364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498357 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-socket-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498426 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-systemd\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-kubelet\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498497 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/560e36eb-1307-4281-8d72-48e17f8f5182-etc-tuned\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf4nq\" (UniqueName: \"kubernetes.io/projected/60322628-a4bd-43d4-915a-06c477f5d4b1-kube-api-access-nf4nq\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-kubelet\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498626 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-cni-bin\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-k8s-cni-cncf-io\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-hostroot\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/560e36eb-1307-4281-8d72-48e17f8f5182-tmp\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498781 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovn-node-metrics-cert\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg4xp\" (UniqueName: \"kubernetes.io/projected/06780cd0-e441-458b-b371-d13377d92f6c-kube-api-access-cg4xp\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498859 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ddw5\" (UniqueName: \"kubernetes.io/projected/ef377deb-47f7-4251-b74c-d3e770cdc31a-kube-api-access-4ddw5\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-run-ovn-kubernetes\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.499102 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498950 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.499803 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.498993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-env-overrides\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.499803 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.499034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06780cd0-e441-458b-b371-d13377d92f6c-multus-daemon-config\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.499803 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.499062 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-etc-kubernetes\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.499803 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.499122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-sys\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.499803 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.499146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-node-log\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.499803 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.499189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-cni-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.501555 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.501538 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 12:34:29.513738 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.513695 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 12:29:28 +0000 UTC" deadline="2028-04-05 12:48:14.028293509 +0000 UTC" Sep 07 12:34:29.513738 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.513731 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13824h13m44.514564651s" Sep 07 12:34:29.531804 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.531782 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2bqb2" Sep 07 12:34:29.541526 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.541509 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2bqb2" Sep 07 12:34:29.590462 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.590446 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 12:34:29.599991 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.599972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-multus-certs\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.600051 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.599998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7535637d-a3cc-40d0-aec7-fdecedf5ef72-konnectivity-ca\") pod \"konnectivity-agent-9clw7\" (UID: \"7535637d-a3cc-40d0-aec7-fdecedf5ef72\") " pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:29.600051 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48073f83-c67b-4245-abf9-2cd1b66e77d6-host-slash\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.600122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600034 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-var-lib-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.600122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600072 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-ovn\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.600122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600077 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-multus-certs\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.600122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600115 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-ovn\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.600122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600115 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-var-lib-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.600283 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-log-socket\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.600283 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600167 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzxvf\" (UniqueName: \"kubernetes.io/projected/028404bc-6452-4d60-8962-cd8f899f8fdf-kube-api-access-qzxvf\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.600283 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-sys-fs\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.600283 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600197 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-log-socket\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.600283 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600216 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.600283 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-device-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.600283 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600251 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-sys-fs\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.600283 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600269 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/925c9026-83d4-4471-a185-8b600a58492a-dbus\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600294 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gx7t\" (UniqueName: \"kubernetes.io/projected/5e722016-4e1c-4cd0-80cb-19d044cc821e-kube-api-access-6gx7t\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysctl-conf\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600337 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-device-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-systemd\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600407 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-systemd\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600471 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysctl-conf\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-system-cni-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-cnibin\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600553 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-conf-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.600559 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600558 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7535637d-a3cc-40d0-aec7-fdecedf5ef72-konnectivity-ca\") pod \"konnectivity-agent-9clw7\" (UID: \"7535637d-a3cc-40d0-aec7-fdecedf5ef72\") " pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-lib-modules\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600610 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-cnibin\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600605 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-system-cni-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600626 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-conf-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600657 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r54rt\" (UniqueName: \"kubernetes.io/projected/560e36eb-1307-4281-8d72-48e17f8f5182-kube-api-access-r54rt\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600689 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-system-cni-dir\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600704 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-lib-modules\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-cnibin\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600721 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-registration-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600726 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-system-cni-dir\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600756 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/028404bc-6452-4d60-8962-cd8f899f8fdf-cnibin\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600781 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-registration-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqdwf\" (UniqueName: \"kubernetes.io/projected/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-kube-api-access-hqdwf\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea852cfd-9f11-41eb-9526-90abd8e907b2-serviceca\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.601068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600822 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef377deb-47f7-4251-b74c-d3e770cdc31a-hosts-file\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovnkube-script-lib\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-socket-dir-parent\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-cni-multus\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600919 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef377deb-47f7-4251-b74c-d3e770cdc31a-hosts-file\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.600934 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600941 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7535637d-a3cc-40d0-aec7-fdecedf5ef72-agent-certs\") pod \"konnectivity-agent-9clw7\" (UID: \"7535637d-a3cc-40d0-aec7-fdecedf5ef72\") " pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/925c9026-83d4-4471-a185-8b600a58492a-kubelet-config\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.600990 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-cni-multus\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.601004 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:34:30.100984026 +0000 UTC m=+2.026424320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601069 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601075 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-socket-dir-parent\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601091 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-cni-netd\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601127 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.601846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601136 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea852cfd-9f11-41eb-9526-90abd8e907b2-host\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601137 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601172 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-cni-netd\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601171 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysconfig\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef377deb-47f7-4251-b74c-d3e770cdc31a-tmp-dir\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601204 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysconfig\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-systemd-units\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601218 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea852cfd-9f11-41eb-9526-90abd8e907b2-host\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-run-netns\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601247 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-run-netns\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601268 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-cni-bin\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601281 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-systemd-units\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601288 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea852cfd-9f11-41eb-9526-90abd8e907b2-serviceca\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsbsr\" (UniqueName: \"kubernetes.io/projected/48073f83-c67b-4245-abf9-2cd1b66e77d6-kube-api-access-dsbsr\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601306 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-cni-bin\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601301 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601324 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbg7n\" (UniqueName: \"kubernetes.io/projected/ea852cfd-9f11-41eb-9526-90abd8e907b2-kube-api-access-kbg7n\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601350 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-kubernetes\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.602666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysctl-d\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-run\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601437 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-kubernetes\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-host\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601532 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-slash\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601546 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-run\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601582 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-slash\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601588 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef377deb-47f7-4251-b74c-d3e770cdc31a-tmp-dir\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601591 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06780cd0-e441-458b-b371-d13377d92f6c-cni-binary-copy\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601632 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-host\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601644 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-sysctl-d\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-modprobe-d\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601674 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-socket-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601707 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-etc-modprobe-d\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-systemd\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-kubelet\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.603519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601769 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-run-systemd\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601770 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/560e36eb-1307-4281-8d72-48e17f8f5182-etc-tuned\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601889 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-var-lib-kubelet\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601882 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf4nq\" (UniqueName: \"kubernetes.io/projected/60322628-a4bd-43d4-915a-06c477f5d4b1-kube-api-access-nf4nq\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-kubelet\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601940 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovnkube-script-lib\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-cni-bin\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-k8s-cni-cncf-io\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-hostroot\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602070 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/560e36eb-1307-4281-8d72-48e17f8f5182-tmp\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.601846 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60322628-a4bd-43d4-915a-06c477f5d4b1-socket-dir\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovn-node-metrics-cert\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602164 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg4xp\" (UniqueName: \"kubernetes.io/projected/06780cd0-e441-458b-b371-d13377d92f6c-kube-api-access-cg4xp\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602168 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602196 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48073f83-c67b-4245-abf9-2cd1b66e77d6-iptables-alerter-script\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602219 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-cni-bin\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604416 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ddw5\" (UniqueName: \"kubernetes.io/projected/ef377deb-47f7-4251-b74c-d3e770cdc31a-kube-api-access-4ddw5\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602222 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-hostroot\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602170 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-k8s-cni-cncf-io\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602282 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-kubelet\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602286 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-run-ovn-kubernetes\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602296 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/028404bc-6452-4d60-8962-cd8f899f8fdf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602314 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602353 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-run-ovn-kubernetes\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602358 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-env-overrides\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602394 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06780cd0-e441-458b-b371-d13377d92f6c-multus-daemon-config\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-etc-kubernetes\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-sys\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-node-log\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-cni-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-var-lib-kubelet\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602577 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602612 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-etc-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.604953 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovnkube-config\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-netns\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602701 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-multus-cni-dir\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602720 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06780cd0-e441-458b-b371-d13377d92f6c-cni-binary-copy\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602728 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-host-run-netns\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602752 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06780cd0-e441-458b-b371-d13377d92f6c-etc-kubernetes\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602765 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-var-lib-kubelet\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602766 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-env-overrides\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602797 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/560e36eb-1307-4281-8d72-48e17f8f5182-sys\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602803 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602832 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-etc-openvswitch\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602842 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-node-log\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.602874 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06780cd0-e441-458b-b371-d13377d92f6c-multus-daemon-config\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.603243 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovnkube-config\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.604699 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/560e36eb-1307-4281-8d72-48e17f8f5182-etc-tuned\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.604719 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-ovn-node-metrics-cert\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.604733 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/560e36eb-1307-4281-8d72-48e17f8f5182-tmp\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.605452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.604804 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7535637d-a3cc-40d0-aec7-fdecedf5ef72-agent-certs\") pod \"konnectivity-agent-9clw7\" (UID: \"7535637d-a3cc-40d0-aec7-fdecedf5ef72\") " pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:29.618858 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.618833 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf4nq\" (UniqueName: \"kubernetes.io/projected/60322628-a4bd-43d4-915a-06c477f5d4b1-kube-api-access-nf4nq\") pod \"aws-ebs-csi-driver-node-dnl5h\" (UID: \"60322628-a4bd-43d4-915a-06c477f5d4b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.619384 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.619364 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r54rt\" (UniqueName: \"kubernetes.io/projected/560e36eb-1307-4281-8d72-48e17f8f5182-kube-api-access-r54rt\") pod \"tuned-mwmpw\" (UID: \"560e36eb-1307-4281-8d72-48e17f8f5182\") " pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.620172 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.620156 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:29.620172 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.620174 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:29.620301 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.620183 2558 projected.go:196] Error preparing data for projected volume kube-api-access-w9hcv for pod openshift-network-diagnostics/network-check-target-9zw99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:29.620301 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.620229 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv podName:9b246143-b890-4fcb-bc09-70276a79f00d nodeName:}" failed. No retries permitted until 2026-09-07 12:34:30.120216832 +0000 UTC m=+2.045657118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w9hcv" (UniqueName: "kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv") pod "network-check-target-9zw99" (UID: "9b246143-b890-4fcb-bc09-70276a79f00d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:29.622899 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.622876 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbg7n\" (UniqueName: \"kubernetes.io/projected/ea852cfd-9f11-41eb-9526-90abd8e907b2-kube-api-access-kbg7n\") pod \"node-ca-lnp54\" (UID: \"ea852cfd-9f11-41eb-9526-90abd8e907b2\") " pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.623768 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.623746 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqdwf\" (UniqueName: \"kubernetes.io/projected/28179a4f-4934-4d40-ab4b-446a0a9b0d5e-kube-api-access-hqdwf\") pod \"ovnkube-node-b7xfc\" (UID: \"28179a4f-4934-4d40-ab4b-446a0a9b0d5e\") " pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.624230 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.624209 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gx7t\" (UniqueName: \"kubernetes.io/projected/5e722016-4e1c-4cd0-80cb-19d044cc821e-kube-api-access-6gx7t\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:29.624342 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.624325 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ddw5\" (UniqueName: \"kubernetes.io/projected/ef377deb-47f7-4251-b74c-d3e770cdc31a-kube-api-access-4ddw5\") pod \"node-resolver-lm4z6\" (UID: \"ef377deb-47f7-4251-b74c-d3e770cdc31a\") " pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.625366 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.625343 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzxvf\" (UniqueName: \"kubernetes.io/projected/028404bc-6452-4d60-8962-cd8f899f8fdf-kube-api-access-qzxvf\") pod \"multus-additional-cni-plugins-cjqkf\" (UID: \"028404bc-6452-4d60-8962-cd8f899f8fdf\") " pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.626299 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.626268 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg4xp\" (UniqueName: \"kubernetes.io/projected/06780cd0-e441-458b-b371-d13377d92f6c-kube-api-access-cg4xp\") pod \"multus-xclkq\" (UID: \"06780cd0-e441-458b-b371-d13377d92f6c\") " pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.636112 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.636094 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lm4z6" Sep 07 12:34:29.703779 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.703747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/925c9026-83d4-4471-a185-8b600a58492a-dbus\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.703993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.703802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/925c9026-83d4-4471-a185-8b600a58492a-kubelet-config\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.703993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.703827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.703993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.703853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsbsr\" (UniqueName: \"kubernetes.io/projected/48073f83-c67b-4245-abf9-2cd1b66e77d6-kube-api-access-dsbsr\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.703993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.703868 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/925c9026-83d4-4471-a185-8b600a58492a-dbus\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.703993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.703903 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48073f83-c67b-4245-abf9-2cd1b66e77d6-iptables-alerter-script\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.703993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.703926 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/925c9026-83d4-4471-a185-8b600a58492a-kubelet-config\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:29.703993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.703961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48073f83-c67b-4245-abf9-2cd1b66e77d6-host-slash\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.703993 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.703973 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:29.704380 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:29.704026 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret podName:925c9026-83d4-4471-a185-8b600a58492a nodeName:}" failed. No retries permitted until 2026-09-07 12:34:30.204010326 +0000 UTC m=+2.129450611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret") pod "global-pull-secret-syncer-5zjc4" (UID: "925c9026-83d4-4471-a185-8b600a58492a") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:29.704380 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.704023 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48073f83-c67b-4245-abf9-2cd1b66e77d6-host-slash\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.704459 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.704392 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48073f83-c67b-4245-abf9-2cd1b66e77d6-iptables-alerter-script\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.712152 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.712132 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsbsr\" (UniqueName: \"kubernetes.io/projected/48073f83-c67b-4245-abf9-2cd1b66e77d6-kube-api-access-dsbsr\") pod \"iptables-alerter-mvhcz\" (UID: \"48073f83-c67b-4245-abf9-2cd1b66e77d6\") " pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.796555 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.796496 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lnp54" Sep 07 12:34:29.806188 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.806166 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:29.836671 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.836644 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xclkq" Sep 07 12:34:29.856373 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.856353 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" Sep 07 12:34:29.872030 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.872007 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:29.887590 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.887568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" Sep 07 12:34:29.897190 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:29.897157 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560e36eb_1307_4281_8d72_48e17f8f5182.slice/crio-c95a617576f32643ca97da2f7657d8a7d251c3b455538e2b2ac9073d3c2275df WatchSource:0}: Error finding container c95a617576f32643ca97da2f7657d8a7d251c3b455538e2b2ac9073d3c2275df: Status 404 returned error can't find the container with id c95a617576f32643ca97da2f7657d8a7d251c3b455538e2b2ac9073d3c2275df Sep 07 12:34:29.897847 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:29.897824 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7535637d_a3cc_40d0_aec7_fdecedf5ef72.slice/crio-5516b8bca277ea016507301e21af80a7a2a4f5da3c7ee2a1b804c9a5085b87fd WatchSource:0}: Error finding container 5516b8bca277ea016507301e21af80a7a2a4f5da3c7ee2a1b804c9a5085b87fd: Status 404 returned error can't find the container with id 5516b8bca277ea016507301e21af80a7a2a4f5da3c7ee2a1b804c9a5085b87fd Sep 07 12:34:29.898384 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:29.898357 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06780cd0_e441_458b_b371_d13377d92f6c.slice/crio-f4345e67cdcf6cb49d949ad38952109d04ce38038b26a13ab35e0f4368bf0efd WatchSource:0}: Error finding container f4345e67cdcf6cb49d949ad38952109d04ce38038b26a13ab35e0f4368bf0efd: Status 404 returned error can't find the container with id f4345e67cdcf6cb49d949ad38952109d04ce38038b26a13ab35e0f4368bf0efd Sep 07 12:34:29.899238 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:29.899221 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed4608990e828571d9e6032ee57e26d.slice/crio-8bc5cd6eff9fae7c541da1e091cb2d3531b16fa0e941cec4033d89cb1b131238 WatchSource:0}: Error finding container 8bc5cd6eff9fae7c541da1e091cb2d3531b16fa0e941cec4033d89cb1b131238: Status 404 returned error can't find the container with id 8bc5cd6eff9fae7c541da1e091cb2d3531b16fa0e941cec4033d89cb1b131238 Sep 07 12:34:29.900209 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:29.900191 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c32b47062b68759893f0dbb8cc31abb.slice/crio-877e56e5a4afeb07b11ffdfc8955c2c7d6306bdfbfb7221946b0791324133834 WatchSource:0}: Error finding container 877e56e5a4afeb07b11ffdfc8955c2c7d6306bdfbfb7221946b0791324133834: Status 404 returned error can't find the container with id 877e56e5a4afeb07b11ffdfc8955c2c7d6306bdfbfb7221946b0791324133834 Sep 07 12:34:29.902456 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.902338 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:34:29.902583 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:29.902499 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028404bc_6452_4d60_8962_cd8f899f8fdf.slice/crio-dae679f3a21fa8c78f1914d9c7f094f8916af24ac1ae752f2cc41dfb3245082f WatchSource:0}: Error finding container dae679f3a21fa8c78f1914d9c7f094f8916af24ac1ae752f2cc41dfb3245082f: Status 404 returned error can't find the container with id dae679f3a21fa8c78f1914d9c7f094f8916af24ac1ae752f2cc41dfb3245082f Sep 07 12:34:29.906446 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.906424 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" Sep 07 12:34:29.915825 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:29.915782 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60322628_a4bd_43d4_915a_06c477f5d4b1.slice/crio-8e45e8d872523bcb301121873f287fcd081a73b2f5049da7b387f4868e3b0802 WatchSource:0}: Error finding container 8e45e8d872523bcb301121873f287fcd081a73b2f5049da7b387f4868e3b0802: Status 404 returned error can't find the container with id 8e45e8d872523bcb301121873f287fcd081a73b2f5049da7b387f4868e3b0802 Sep 07 12:34:29.942415 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:29.942394 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mvhcz" Sep 07 12:34:29.950984 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:29.950963 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48073f83_c67b_4245_abf9_2cd1b66e77d6.slice/crio-c6e4f7fedb35f777e2fd4b70b92e366ba9ed2d0591dbce8308a01b8e91c851ee WatchSource:0}: Error finding container c6e4f7fedb35f777e2fd4b70b92e366ba9ed2d0591dbce8308a01b8e91c851ee: Status 404 returned error can't find the container with id c6e4f7fedb35f777e2fd4b70b92e366ba9ed2d0591dbce8308a01b8e91c851ee Sep 07 12:34:30.031634 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:30.031608 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef377deb_47f7_4251_b74c_d3e770cdc31a.slice/crio-380aa05056699c9bf302e7bfb2429fb1e91261a84ec75dface8088e44bf69dab WatchSource:0}: Error finding container 380aa05056699c9bf302e7bfb2429fb1e91261a84ec75dface8088e44bf69dab: Status 404 returned error can't find the container with id 380aa05056699c9bf302e7bfb2429fb1e91261a84ec75dface8088e44bf69dab Sep 07 12:34:30.049707 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.049651 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:30.106812 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.106783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:30.106947 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.106919 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:30.106992 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.106977 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:34:31.106961378 +0000 UTC m=+3.032401659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:30.208050 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.208023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:30.208184 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.208080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:30.208184 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.208164 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:30.208184 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.208179 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:30.208278 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.208195 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:30.208278 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.208207 2558 projected.go:196] Error preparing data for projected volume kube-api-access-w9hcv for pod openshift-network-diagnostics/network-check-target-9zw99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:30.208278 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.208227 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret podName:925c9026-83d4-4471-a185-8b600a58492a nodeName:}" failed. No retries permitted until 2026-09-07 12:34:31.208208155 +0000 UTC m=+3.133648452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret") pod "global-pull-secret-syncer-5zjc4" (UID: "925c9026-83d4-4471-a185-8b600a58492a") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:30.208278 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.208245 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv podName:9b246143-b890-4fcb-bc09-70276a79f00d nodeName:}" failed. No retries permitted until 2026-09-07 12:34:31.208233387 +0000 UTC m=+3.133673673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9hcv" (UniqueName: "kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv") pod "network-check-target-9zw99" (UID: "9b246143-b890-4fcb-bc09-70276a79f00d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:30.265323 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:30.265298 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28179a4f_4934_4d40_ab4b_446a0a9b0d5e.slice/crio-71b96ff757466dc78eee2d34a4e10e2bbf7b9b99a31002b04c60662f01e07e0d WatchSource:0}: Error finding container 71b96ff757466dc78eee2d34a4e10e2bbf7b9b99a31002b04c60662f01e07e0d: Status 404 returned error can't find the container with id 71b96ff757466dc78eee2d34a4e10e2bbf7b9b99a31002b04c60662f01e07e0d Sep 07 12:34:30.431379 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.431311 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:30.545005 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.544964 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:29:29 +0000 UTC" deadline="2028-06-24 03:13:34.199339826 +0000 UTC" Sep 07 12:34:30.545005 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.545003 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15734h39m3.65434148s" Sep 07 12:34:30.584656 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.584629 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:30.584825 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:30.584767 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:30.590050 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.589997 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mvhcz" event={"ID":"48073f83-c67b-4245-abf9-2cd1b66e77d6","Type":"ContainerStarted","Data":"c6e4f7fedb35f777e2fd4b70b92e366ba9ed2d0591dbce8308a01b8e91c851ee"} Sep 07 12:34:30.592287 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.592261 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" event={"ID":"60322628-a4bd-43d4-915a-06c477f5d4b1","Type":"ContainerStarted","Data":"8e45e8d872523bcb301121873f287fcd081a73b2f5049da7b387f4868e3b0802"} Sep 07 12:34:30.597508 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.597467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" event={"ID":"028404bc-6452-4d60-8962-cd8f899f8fdf","Type":"ContainerStarted","Data":"dae679f3a21fa8c78f1914d9c7f094f8916af24ac1ae752f2cc41dfb3245082f"} Sep 07 12:34:30.600405 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.600356 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" event={"ID":"560e36eb-1307-4281-8d72-48e17f8f5182","Type":"ContainerStarted","Data":"c95a617576f32643ca97da2f7657d8a7d251c3b455538e2b2ac9073d3c2275df"} Sep 07 12:34:30.605061 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.605036 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9clw7" event={"ID":"7535637d-a3cc-40d0-aec7-fdecedf5ef72","Type":"ContainerStarted","Data":"5516b8bca277ea016507301e21af80a7a2a4f5da3c7ee2a1b804c9a5085b87fd"} Sep 07 12:34:30.615525 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.611759 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"71b96ff757466dc78eee2d34a4e10e2bbf7b9b99a31002b04c60662f01e07e0d"} Sep 07 12:34:30.615525 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.614031 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"2c32b47062b68759893f0dbb8cc31abb","Type":"ContainerStarted","Data":"877e56e5a4afeb07b11ffdfc8955c2c7d6306bdfbfb7221946b0791324133834"} Sep 07 12:34:30.618306 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.618281 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" event={"ID":"6ed4608990e828571d9e6032ee57e26d","Type":"ContainerStarted","Data":"8bc5cd6eff9fae7c541da1e091cb2d3531b16fa0e941cec4033d89cb1b131238"} Sep 07 12:34:30.622455 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.622430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xclkq" event={"ID":"06780cd0-e441-458b-b371-d13377d92f6c","Type":"ContainerStarted","Data":"f4345e67cdcf6cb49d949ad38952109d04ce38038b26a13ab35e0f4368bf0efd"} Sep 07 12:34:30.626179 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:30.626153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lm4z6" event={"ID":"ef377deb-47f7-4251-b74c-d3e770cdc31a","Type":"ContainerStarted","Data":"380aa05056699c9bf302e7bfb2429fb1e91261a84ec75dface8088e44bf69dab"} Sep 07 12:34:31.116378 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.115805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:31.116378 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.115949 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:31.116378 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.116012 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:34:33.115992785 +0000 UTC m=+5.041433068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:31.216860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.216822 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:31.217048 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.216908 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:31.217111 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.217067 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:31.217111 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.217091 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:31.217111 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.217104 2558 projected.go:196] Error preparing data for projected volume kube-api-access-w9hcv for pod openshift-network-diagnostics/network-check-target-9zw99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:31.217261 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.217164 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv podName:9b246143-b890-4fcb-bc09-70276a79f00d nodeName:}" failed. No retries permitted until 2026-09-07 12:34:33.217144993 +0000 UTC m=+5.142585295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9hcv" (UniqueName: "kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv") pod "network-check-target-9zw99" (UID: "9b246143-b890-4fcb-bc09-70276a79f00d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:31.217603 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.217570 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:31.217707 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.217628 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret podName:925c9026-83d4-4471-a185-8b600a58492a nodeName:}" failed. No retries permitted until 2026-09-07 12:34:33.217613388 +0000 UTC m=+5.143053676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret") pod "global-pull-secret-syncer-5zjc4" (UID: "925c9026-83d4-4471-a185-8b600a58492a") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:31.416761 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:34:31.416723 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea852cfd_9f11_41eb_9526_90abd8e907b2.slice/crio-8967573695b52547ba9fcb63b92ad36cbea0906fa58b0c2a3d722d47d008900f WatchSource:0}: Error finding container 8967573695b52547ba9fcb63b92ad36cbea0906fa58b0c2a3d722d47d008900f: Status 404 returned error can't find the container with id 8967573695b52547ba9fcb63b92ad36cbea0906fa58b0c2a3d722d47d008900f Sep 07 12:34:31.527588 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.527557 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:31.546887 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.546814 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:29:29 +0000 UTC" deadline="2028-06-23 04:41:48.317445226 +0000 UTC" Sep 07 12:34:31.546887 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.546874 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15712h7m16.770575575s" Sep 07 12:34:31.583282 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.583253 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:31.583442 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.583392 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:31.583814 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.583793 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:31.583906 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:31.583889 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:31.637713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:31.637655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lnp54" event={"ID":"ea852cfd-9f11-41eb-9526-90abd8e907b2","Type":"ContainerStarted","Data":"8967573695b52547ba9fcb63b92ad36cbea0906fa58b0c2a3d722d47d008900f"} Sep 07 12:34:32.585769 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:32.585741 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:32.586207 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:32.585876 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:33.134407 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:33.134370 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:33.134613 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.134557 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:33.134688 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.134620 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:34:37.134601553 +0000 UTC m=+9.060041851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:33.235300 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:33.235262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:33.235464 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:33.235350 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:33.235604 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.235547 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:33.235604 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.235583 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:33.235604 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.235582 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:33.235604 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.235593 2558 projected.go:196] Error preparing data for projected volume kube-api-access-w9hcv for pod openshift-network-diagnostics/network-check-target-9zw99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:33.235824 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.235643 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv podName:9b246143-b890-4fcb-bc09-70276a79f00d nodeName:}" failed. No retries permitted until 2026-09-07 12:34:37.235629303 +0000 UTC m=+9.161069590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9hcv" (UniqueName: "kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv") pod "network-check-target-9zw99" (UID: "9b246143-b890-4fcb-bc09-70276a79f00d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:33.235824 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.235658 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret podName:925c9026-83d4-4471-a185-8b600a58492a nodeName:}" failed. No retries permitted until 2026-09-07 12:34:37.2356521 +0000 UTC m=+9.161092382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret") pod "global-pull-secret-syncer-5zjc4" (UID: "925c9026-83d4-4471-a185-8b600a58492a") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:33.583918 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:33.583819 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:33.584087 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:33.583947 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:33.584087 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.583950 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:33.584087 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:33.584053 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:34.584347 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:34.584312 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:34.584838 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:34.584460 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:35.583448 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:35.583409 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:35.583448 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:35.583409 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:35.583708 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:35.583585 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:35.583765 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:35.583705 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:36.583907 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:36.583847 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:36.584357 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:36.584012 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:37.170381 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:37.170334 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:37.170567 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.170525 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:37.170649 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.170603 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:34:45.170581912 +0000 UTC m=+17.096022208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:37.271402 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:37.271338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:37.271603 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:37.271410 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:37.271603 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.271501 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:37.271603 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.271557 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:37.271603 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.271570 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret podName:925c9026-83d4-4471-a185-8b600a58492a nodeName:}" failed. No retries permitted until 2026-09-07 12:34:45.27155013 +0000 UTC m=+17.196990421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret") pod "global-pull-secret-syncer-5zjc4" (UID: "925c9026-83d4-4471-a185-8b600a58492a") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:37.271603 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.271577 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:37.271603 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.271591 2558 projected.go:196] Error preparing data for projected volume kube-api-access-w9hcv for pod openshift-network-diagnostics/network-check-target-9zw99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:37.271908 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.271638 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv podName:9b246143-b890-4fcb-bc09-70276a79f00d nodeName:}" failed. No retries permitted until 2026-09-07 12:34:45.271624111 +0000 UTC m=+17.197064398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9hcv" (UniqueName: "kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv") pod "network-check-target-9zw99" (UID: "9b246143-b890-4fcb-bc09-70276a79f00d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:37.583594 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:37.583512 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:37.583752 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.583648 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:37.583752 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:37.583665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:37.583842 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:37.583770 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:38.584704 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:38.584187 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:38.584704 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:38.584344 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:39.583592 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:39.583552 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:39.583781 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:39.583552 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:39.583781 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:39.583706 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:39.583781 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:39.583769 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:40.584327 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:40.584287 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:40.584820 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:40.584448 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:41.583526 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:41.583462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:41.583714 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:41.583610 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:41.583714 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:41.583661 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:41.583830 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:41.583764 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:42.584019 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:42.583982 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:42.584506 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:42.584129 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:43.583827 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:43.583792 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:43.583978 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:43.583839 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:43.583978 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:43.583913 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:43.584085 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:43.584028 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:44.583309 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:44.583276 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:44.583439 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:44.583418 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:45.230095 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:45.230050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:45.230549 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.230206 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:45.230549 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.230275 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:35:01.230254379 +0000 UTC m=+33.155694674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:45.331231 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:45.331192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:45.331402 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:45.331262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:45.331402 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.331353 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:45.331402 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.331388 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:45.331621 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.331408 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:45.331621 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.331421 2558 projected.go:196] Error preparing data for projected volume kube-api-access-w9hcv for pod openshift-network-diagnostics/network-check-target-9zw99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:45.331621 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.331435 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret podName:925c9026-83d4-4471-a185-8b600a58492a nodeName:}" failed. No retries permitted until 2026-09-07 12:35:01.331414097 +0000 UTC m=+33.256854380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret") pod "global-pull-secret-syncer-5zjc4" (UID: "925c9026-83d4-4471-a185-8b600a58492a") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:45.331621 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.331471 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv podName:9b246143-b890-4fcb-bc09-70276a79f00d nodeName:}" failed. No retries permitted until 2026-09-07 12:35:01.331456257 +0000 UTC m=+33.256896553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9hcv" (UniqueName: "kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv") pod "network-check-target-9zw99" (UID: "9b246143-b890-4fcb-bc09-70276a79f00d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:45.583296 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:45.583214 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:45.583296 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:45.583214 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:45.583530 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.583357 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:45.583530 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:45.583469 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:46.583990 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:46.583948 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:46.584412 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:46.584096 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:47.583939 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:47.583904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:47.584128 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:47.583905 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:47.584128 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:47.584021 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:47.584128 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:47.584118 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:48.584682 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:48.584643 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:48.585157 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:48.584768 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:49.584295 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.583598 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:49.584295 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:49.583950 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:49.584295 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.584174 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:49.584295 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:49.584255 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:49.673389 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.673362 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" event={"ID":"560e36eb-1307-4281-8d72-48e17f8f5182","Type":"ContainerStarted","Data":"87aa367c40bb450484e4c5191c941125c2564f92a30f69f6b81401383f16ca85"} Sep 07 12:34:49.681218 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.680458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"810d85cc9ebb893919985c3fe7968fdbed5c8b1fdde5725724f0c7ad136ced15"} Sep 07 12:34:49.681218 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.680567 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"ed0ccc01b0b3b44600f16a07550d081a3b06c426ac6a0f13ab77352549faa3f4"} Sep 07 12:34:49.681218 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.680623 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"045aebbcf56bfa893242916bc1fbd6a3687813d8747b06d6e3ef517eb6312f22"} Sep 07 12:34:49.683511 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.683403 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" event={"ID":"6ed4608990e828571d9e6032ee57e26d","Type":"ContainerStarted","Data":"91660d294b28c2d8500b0051ab8166b911d00cdee0525d3a560dc89ff0144e76"} Sep 07 12:34:49.685575 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.685365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xclkq" event={"ID":"06780cd0-e441-458b-b371-d13377d92f6c","Type":"ContainerStarted","Data":"4eef0c0332916aba36598bae31b8fb96cefca25b7b22b366710da6351e03b253"} Sep 07 12:34:49.692976 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.692937 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mwmpw" podStartSLOduration=2.608286802 podStartE2EDuration="21.692924719s" totalImagesPullingTime="19.084637917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:49.692330203 +0000 UTC m=+21.617770524" watchObservedRunningTime="2026-09-07 12:34:49.692924719 +0000 UTC m=+21.618365022" Sep 07 12:34:49.705189 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:49.705137 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" podStartSLOduration=20.705116678 podStartE2EDuration="20.705116678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:49.704957603 +0000 UTC m=+21.630397931" watchObservedRunningTime="2026-09-07 12:34:49.705116678 +0000 UTC m=+21.630556986" Sep 07 12:34:50.584063 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.583819 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:50.584236 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:50.584211 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:50.689415 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.689381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lm4z6" event={"ID":"ef377deb-47f7-4251-b74c-d3e770cdc31a","Type":"ContainerStarted","Data":"378534dc30912152ecd2da17d497b791486c4e40df57650e4bd898538645a1f4"} Sep 07 12:34:50.691231 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.691201 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mvhcz" event={"ID":"48073f83-c67b-4245-abf9-2cd1b66e77d6","Type":"ContainerStarted","Data":"0ba6b60c668c7ee0b4dbf33a82ec2b30572dce408fcc75dc84d7175bb4ee69e5"} Sep 07 12:34:50.692986 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.692957 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" event={"ID":"60322628-a4bd-43d4-915a-06c477f5d4b1","Type":"ContainerStarted","Data":"8d42742044401b9b506c3f39e315718180cec70b6b49f64f02c73d1486fa1e59"} Sep 07 12:34:50.694566 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.694538 2558 generic.go:356] "Generic (PLEG): container finished" podID="028404bc-6452-4d60-8962-cd8f899f8fdf" containerID="902f4532f796bdfad15b53a3862a34cc0c1a8f59b82082bee4181094109fca10" exitCode=0 Sep 07 12:34:50.694664 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.694625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" event={"ID":"028404bc-6452-4d60-8962-cd8f899f8fdf","Type":"ContainerDied","Data":"902f4532f796bdfad15b53a3862a34cc0c1a8f59b82082bee4181094109fca10"} Sep 07 12:34:50.696257 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.696239 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9clw7" event={"ID":"7535637d-a3cc-40d0-aec7-fdecedf5ef72","Type":"ContainerStarted","Data":"e2df8567d636c6ba07c22a17a5b03f5eef62204ef9eeff8f0545a21d02030a95"} Sep 07 12:34:50.698080 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.698055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lnp54" event={"ID":"ea852cfd-9f11-41eb-9526-90abd8e907b2","Type":"ContainerStarted","Data":"f5a0e338d0535014ec5b2c433e14a9071320fe3a9f49126aaf927c1e2228b858"} Sep 07 12:34:50.701541 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.701517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"3d6d20d0ce57e4684f379461be50487b44269d38f5dcd9cde2e416ddfa15fd1b"} Sep 07 12:34:50.701666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.701592 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"03a50363632d0f96f49623314dd5591a832d68c0930edd062ff5be2c030c4a17"} Sep 07 12:34:50.701666 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.701638 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"4e70b9df51f4b9442b50ee351072aaf524ecf6b6990c527ed616b8bc2292783f"} Sep 07 12:34:50.703387 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.703362 2558 generic.go:356] "Generic (PLEG): container finished" podID="2c32b47062b68759893f0dbb8cc31abb" containerID="b7d2be504ff43f3cb9ad78dd8f2f2bd2502165c6d4f69a269480684c0eed5b40" exitCode=0 Sep 07 12:34:50.703501 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.703374 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lm4z6" podStartSLOduration=3.750218257 podStartE2EDuration="22.703355981s" totalImagesPullingTime="18.953137724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:50.703031776 +0000 UTC m=+22.628472101" watchObservedRunningTime="2026-09-07 12:34:50.703355981 +0000 UTC m=+22.628796285" Sep 07 12:34:50.703501 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.703439 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"2c32b47062b68759893f0dbb8cc31abb","Type":"ContainerDied","Data":"b7d2be504ff43f3cb9ad78dd8f2f2bd2502165c6d4f69a269480684c0eed5b40"} Sep 07 12:34:50.703501 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.703467 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xclkq" podStartSLOduration=3.5848185949999998 podStartE2EDuration="22.703459955s" totalImagesPullingTime="19.11864136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:49.739866276 +0000 UTC m=+21.665306625" watchObservedRunningTime="2026-09-07 12:34:50.703459955 +0000 UTC m=+22.628900260" Sep 07 12:34:50.715379 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.715306 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lnp54" podStartSLOduration=5.156121415 podStartE2EDuration="22.715294142s" totalImagesPullingTime="17.559172727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:50.71516534 +0000 UTC m=+22.640605663" watchObservedRunningTime="2026-09-07 12:34:50.715294142 +0000 UTC m=+22.640734445" Sep 07 12:34:50.728381 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.728338 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9clw7" podStartSLOduration=3.7180842800000002 podStartE2EDuration="22.728325444s" totalImagesPullingTime="19.010241164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:50.728052178 +0000 UTC m=+22.653492501" watchObservedRunningTime="2026-09-07 12:34:50.728325444 +0000 UTC m=+22.653765749" Sep 07 12:34:50.758846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:50.758799 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mvhcz" podStartSLOduration=3.76169215 podStartE2EDuration="22.758788663s" totalImagesPullingTime="18.997096513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:50.758577746 +0000 UTC m=+22.684018068" watchObservedRunningTime="2026-09-07 12:34:50.758788663 +0000 UTC m=+22.684228967" Sep 07 12:34:51.000300 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.000275 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 12:34:51.240728 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.240648 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:51.241251 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.241233 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:51.557011 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.556817 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T12:34:51.000296915Z","UUID":"a10d744a-bf21-4f88-808b-a882d1695695","Handler":null,"Name":"","Endpoint":""} Sep 07 12:34:51.558441 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.558410 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 12:34:51.558441 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.558443 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 12:34:51.583332 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.583309 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:51.583538 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:51.583416 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:51.583538 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.583440 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:51.583722 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:51.583536 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:51.707790 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.707751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" event={"ID":"60322628-a4bd-43d4-915a-06c477f5d4b1","Type":"ContainerStarted","Data":"6fca547ee5e0dcd5fc7f95595756104136590bffddbfb05330215b3953750fb1"} Sep 07 12:34:51.710114 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.710012 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"2c32b47062b68759893f0dbb8cc31abb","Type":"ContainerStarted","Data":"364de9514c4e9e244fad7831cafcc65fb64b28a5882ec0b6df57d1de223cea63"} Sep 07 12:34:51.711114 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.710781 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:51.711400 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.711374 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9clw7" Sep 07 12:34:51.727240 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:51.727180 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" podStartSLOduration=22.727161993 podStartE2EDuration="22.727161993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:51.727079361 +0000 UTC m=+23.652519677" watchObservedRunningTime="2026-09-07 12:34:51.727161993 +0000 UTC m=+23.652602302" Sep 07 12:34:52.583798 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:52.583748 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:52.583949 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:52.583930 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:52.714907 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:52.714863 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" event={"ID":"60322628-a4bd-43d4-915a-06c477f5d4b1","Type":"ContainerStarted","Data":"be4153ebb26208e6515a286d45a999ebdff93870410dc7a3a9ce47b1fe25ed49"} Sep 07 12:34:52.719228 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:52.719200 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"20dcea9648e1ad1a7aa75e708f0fcddce450a620e82d61929c10ed7b6eb95cb5"} Sep 07 12:34:52.732344 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:52.732303 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnl5h" podStartSLOduration=3.029256769 podStartE2EDuration="24.732288346s" totalImagesPullingTime="21.703031577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:52.732217978 +0000 UTC m=+24.657658300" watchObservedRunningTime="2026-09-07 12:34:52.732288346 +0000 UTC m=+24.657728650" Sep 07 12:34:53.584479 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:53.584292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:53.584683 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:53.584322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:53.584683 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:53.584587 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:53.584683 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:53.584624 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:54.583260 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:54.583235 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:54.583604 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:54.583368 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:54.727315 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:54.727274 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" event={"ID":"28179a4f-4934-4d40-ab4b-446a0a9b0d5e","Type":"ContainerStarted","Data":"2cd659b5251393e82f4c458313f6b3e63fccfc32eb1e51b8d34deaafa6e4405b"} Sep 07 12:34:54.727589 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:54.727553 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:54.742391 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:54.742369 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:54.753220 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:54.753176 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" podStartSLOduration=7.62148583 podStartE2EDuration="26.753160904s" totalImagesPullingTime="19.131675074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:54.752772447 +0000 UTC m=+26.678212752" watchObservedRunningTime="2026-09-07 12:34:54.753160904 +0000 UTC m=+26.678601229" Sep 07 12:34:55.583998 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:55.583829 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:55.584451 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:55.583875 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:55.584451 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:55.584069 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:55.584451 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:55.584128 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:55.732617 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:55.732571 2558 generic.go:356] "Generic (PLEG): container finished" podID="028404bc-6452-4d60-8962-cd8f899f8fdf" containerID="dda1c1958c01d2614b1f6108210e0faf2e7a2dbe627b0d37366b187f847d4ad3" exitCode=0 Sep 07 12:34:55.732796 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:55.732660 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" event={"ID":"028404bc-6452-4d60-8962-cd8f899f8fdf","Type":"ContainerDied","Data":"dda1c1958c01d2614b1f6108210e0faf2e7a2dbe627b0d37366b187f847d4ad3"} Sep 07 12:34:55.733116 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:55.733086 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:55.733244 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:55.733158 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:55.748258 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:55.748241 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:34:56.543993 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:56.543954 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5zjc4"] Sep 07 12:34:56.544183 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:56.544091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:56.544235 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:56.544206 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:56.546244 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:56.546221 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8mnv"] Sep 07 12:34:56.546372 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:56.546333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:56.546461 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:56.546442 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:56.557312 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:56.557285 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9zw99"] Sep 07 12:34:56.557424 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:56.557385 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:56.557498 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:56.557458 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:57.583228 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:57.583207 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:57.583666 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:57.583315 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:34:57.739451 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:57.739363 2558 generic.go:356] "Generic (PLEG): container finished" podID="028404bc-6452-4d60-8962-cd8f899f8fdf" containerID="8145b26e511071403d5b593cdce4e9a1b828dc3e1c3cc93722ee4f0284d417d6" exitCode=0 Sep 07 12:34:57.739629 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:57.739454 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" event={"ID":"028404bc-6452-4d60-8962-cd8f899f8fdf","Type":"ContainerDied","Data":"8145b26e511071403d5b593cdce4e9a1b828dc3e1c3cc93722ee4f0284d417d6"} Sep 07 12:34:58.584965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:58.584924 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:34:58.585521 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:58.585067 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:34:58.585521 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:58.585113 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:34:58.585521 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:58.585219 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:34:58.743501 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:58.743453 2558 generic.go:356] "Generic (PLEG): container finished" podID="028404bc-6452-4d60-8962-cd8f899f8fdf" containerID="f2c7d866460c4164e16b2e4fc4dcca7cb24e35f6b41cf3b5c3b9f7b1063176e4" exitCode=0 Sep 07 12:34:58.743646 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:58.743532 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" event={"ID":"028404bc-6452-4d60-8962-cd8f899f8fdf","Type":"ContainerDied","Data":"f2c7d866460c4164e16b2e4fc4dcca7cb24e35f6b41cf3b5c3b9f7b1063176e4"} Sep 07 12:34:59.583551 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:34:59.583335 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:34:59.583699 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:34:59.583586 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:35:00.583464 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:00.583428 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:35:00.583464 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:00.583450 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:35:00.584045 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:00.583577 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zw99" podUID="9b246143-b890-4fcb-bc09-70276a79f00d" Sep 07 12:35:00.584045 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:00.583683 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zjc4" podUID="925c9026-83d4-4471-a185-8b600a58492a" Sep 07 12:35:01.243364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:01.243333 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:35:01.243638 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.243514 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:35:01.243638 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.243605 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:35:33.243583682 +0000 UTC m=+65.169023979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:35:01.344235 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:01.344197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:35:01.344444 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:01.344271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:35:01.344444 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.344366 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:35:01.344444 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.344396 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:35:01.344444 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.344410 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:35:01.344444 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.344419 2558 projected.go:196] Error preparing data for projected volume kube-api-access-w9hcv for pod openshift-network-diagnostics/network-check-target-9zw99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:35:01.344670 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.344449 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret podName:925c9026-83d4-4471-a185-8b600a58492a nodeName:}" failed. No retries permitted until 2026-09-07 12:35:33.34442756 +0000 UTC m=+65.269867846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret") pod "global-pull-secret-syncer-5zjc4" (UID: "925c9026-83d4-4471-a185-8b600a58492a") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:35:01.344670 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.344469 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv podName:9b246143-b890-4fcb-bc09-70276a79f00d nodeName:}" failed. No retries permitted until 2026-09-07 12:35:33.344459188 +0000 UTC m=+65.269899475 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w9hcv" (UniqueName: "kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv") pod "network-check-target-9zw99" (UID: "9b246143-b890-4fcb-bc09-70276a79f00d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:35:01.583944 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:01.583864 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:35:01.584498 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:01.584023 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:35:02.363187 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.363155 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeReady" Sep 07 12:35:02.363368 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.363299 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 12:35:02.399965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.399931 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bf4547d5b-d4n62"] Sep 07 12:35:02.419877 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.419847 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-k8mph"] Sep 07 12:35:02.420071 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.419996 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.422706 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.422681 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 12:35:02.422837 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.422816 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 12:35:02.422888 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.422816 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bfdzl\"" Sep 07 12:35:02.423409 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.423387 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 12:35:02.429384 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.429099 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 12:35:02.433890 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.433862 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-k8mph"] Sep 07 12:35:02.434026 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.433993 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:02.436422 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.436400 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 07 12:35:02.436590 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.436570 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h88x9\"" Sep 07 12:35:02.436590 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.436585 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 07 12:35:02.444839 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.443194 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bf4547d5b-d4n62"] Sep 07 12:35:02.444839 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.443826 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fzrtk"] Sep 07 12:35:02.459976 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.459921 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rx2cm"] Sep 07 12:35:02.460157 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.460093 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.462619 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.462591 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 12:35:02.463289 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.463265 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 12:35:02.463769 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.463751 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nvqb4\"" Sep 07 12:35:02.474045 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.474016 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fzrtk"] Sep 07 12:35:02.474184 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.474064 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rx2cm" Sep 07 12:35:02.474256 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.474086 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rx2cm"] Sep 07 12:35:02.476742 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.476717 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nm49p\"" Sep 07 12:35:02.476895 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.476765 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 12:35:02.477187 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.477164 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 12:35:02.481418 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.481388 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 12:35:02.551121 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551080 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3541b899-1ac1-4abb-8289-b30e578e1864-tmp-dir\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.551293 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-nginx-conf\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:02.551293 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.551293 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3541b899-1ac1-4abb-8289-b30e578e1864-config-volume\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.551293 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-image-registry-private-configuration\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.551293 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551254 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-bound-sa-token\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.551566 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgjs2\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-kube-api-access-qgjs2\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.551566 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:02.551566 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b77a1de5-5ad1-4adf-b4f5-579ac0bc5429-cert\") pod \"ingress-canary-rx2cm\" (UID: \"b77a1de5-5ad1-4adf-b4f5-579ac0bc5429\") " pod="openshift-ingress-canary/ingress-canary-rx2cm" Sep 07 12:35:02.551566 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551440 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flgbm\" (UniqueName: \"kubernetes.io/projected/3541b899-1ac1-4abb-8289-b30e578e1864-kube-api-access-flgbm\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.551566 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-installation-pull-secrets\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.551566 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551556 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-trusted-ca\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.551845 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pxql\" (UniqueName: \"kubernetes.io/projected/b77a1de5-5ad1-4adf-b4f5-579ac0bc5429-kube-api-access-4pxql\") pod \"ingress-canary-rx2cm\" (UID: \"b77a1de5-5ad1-4adf-b4f5-579ac0bc5429\") " pod="openshift-ingress-canary/ingress-canary-rx2cm" Sep 07 12:35:02.551845 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36f5b992-4259-4a13-a46f-d0b96838abeb-ca-trust-extracted\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.551845 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.551845 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.551699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-certificates\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.583797 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.583766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:35:02.583960 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.583929 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:35:02.586155 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.586134 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 12:35:02.586155 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.586134 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 12:35:02.586447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.586431 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 12:35:02.586552 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.586461 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-npxpb\"" Sep 07 12:35:02.653093 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653009 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3541b899-1ac1-4abb-8289-b30e578e1864-tmp-dir\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.653093 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-nginx-conf\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:02.653093 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.653350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3541b899-1ac1-4abb-8289-b30e578e1864-config-volume\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.653350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653219 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-image-registry-private-configuration\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.653350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-bound-sa-token\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.653350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653279 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgjs2\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-kube-api-access-qgjs2\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.653350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:02.653350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b77a1de5-5ad1-4adf-b4f5-579ac0bc5429-cert\") pod \"ingress-canary-rx2cm\" (UID: \"b77a1de5-5ad1-4adf-b4f5-579ac0bc5429\") " pod="openshift-ingress-canary/ingress-canary-rx2cm" Sep 07 12:35:02.653350 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653351 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flgbm\" (UniqueName: \"kubernetes.io/projected/3541b899-1ac1-4abb-8289-b30e578e1864-kube-api-access-flgbm\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-installation-pull-secrets\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653407 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-trusted-ca\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653425 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3541b899-1ac1-4abb-8289-b30e578e1864-tmp-dir\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653435 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pxql\" (UniqueName: \"kubernetes.io/projected/b77a1de5-5ad1-4adf-b4f5-579ac0bc5429-kube-api-access-4pxql\") pod \"ingress-canary-rx2cm\" (UID: \"b77a1de5-5ad1-4adf-b4f5-579ac0bc5429\") " pod="openshift-ingress-canary/ingress-canary-rx2cm" Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:02.653189 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653512 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36f5b992-4259-4a13-a46f-d0b96838abeb-ca-trust-extracted\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:02.653568 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:03.153548777 +0000 UTC m=+35.078989069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.653720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653617 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-certificates\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.654148 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653748 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3541b899-1ac1-4abb-8289-b30e578e1864-config-volume\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.654148 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.653848 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36f5b992-4259-4a13-a46f-d0b96838abeb-ca-trust-extracted\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.654148 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:02.653890 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:35:02.654148 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:02.653906 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:35:02.654148 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:02.653966 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:35:03.153945936 +0000 UTC m=+35.079386218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:35:02.654148 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.654007 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-nginx-conf\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:02.654397 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.654179 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-certificates\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.654397 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:02.654339 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:35:02.654397 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:02.654386 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:03.154372559 +0000 UTC m=+35.079812850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:35:02.654571 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.654512 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-trusted-ca\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.658363 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.658337 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-installation-pull-secrets\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.658509 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.658388 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b77a1de5-5ad1-4adf-b4f5-579ac0bc5429-cert\") pod \"ingress-canary-rx2cm\" (UID: \"b77a1de5-5ad1-4adf-b4f5-579ac0bc5429\") " pod="openshift-ingress-canary/ingress-canary-rx2cm" Sep 07 12:35:02.658509 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.658391 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-image-registry-private-configuration\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.663359 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.663339 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgjs2\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-kube-api-access-qgjs2\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.663476 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.663371 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-bound-sa-token\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:02.663476 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.663414 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flgbm\" (UniqueName: \"kubernetes.io/projected/3541b899-1ac1-4abb-8289-b30e578e1864-kube-api-access-flgbm\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:02.663654 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.663609 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pxql\" (UniqueName: \"kubernetes.io/projected/b77a1de5-5ad1-4adf-b4f5-579ac0bc5429-kube-api-access-4pxql\") pod \"ingress-canary-rx2cm\" (UID: \"b77a1de5-5ad1-4adf-b4f5-579ac0bc5429\") " pod="openshift-ingress-canary/ingress-canary-rx2cm" Sep 07 12:35:02.784876 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:02.784844 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rx2cm" Sep 07 12:35:03.158699 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:03.158663 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:03.158877 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:03.158728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:03.158877 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:03.158814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:03.158877 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:03.158817 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:03.159056 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:03.158897 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:35:03.159056 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:03.158925 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:04.158910508 +0000 UTC m=+36.084350793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:35:03.159056 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:03.158950 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:04.158936691 +0000 UTC m=+36.084376973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:35:03.159056 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:03.158969 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:35:03.159056 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:03.158989 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:35:03.159056 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:03.159043 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:35:04.159026029 +0000 UTC m=+36.084466315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:35:03.584078 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:03.584005 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:35:03.586632 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:03.586605 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 12:35:03.586769 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:03.586634 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsbg4\"" Sep 07 12:35:04.167432 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:04.167342 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rx2cm"] Sep 07 12:35:04.167605 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:04.167545 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:04.167605 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:04.167596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:04.167729 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:04.167704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:04.167784 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:04.167725 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:35:04.167784 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:04.167743 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:35:04.167865 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:04.167813 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:35:06.167792663 +0000 UTC m=+38.093232961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:35:04.167865 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:04.167828 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:04.167975 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:04.167885 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:06.167872723 +0000 UTC m=+38.093313006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:35:04.167975 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:04.167828 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:35:04.167975 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:04.167924 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:06.167918109 +0000 UTC m=+38.093358390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:35:04.171412 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:35:04.171386 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77a1de5_5ad1_4adf_b4f5_579ac0bc5429.slice/crio-b6db6b466416315583574ae887817989d65da31aa6c97fc9a57eebe6642a0b4c WatchSource:0}: Error finding container b6db6b466416315583574ae887817989d65da31aa6c97fc9a57eebe6642a0b4c: Status 404 returned error can't find the container with id b6db6b466416315583574ae887817989d65da31aa6c97fc9a57eebe6642a0b4c Sep 07 12:35:04.761455 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:04.761222 2558 generic.go:356] "Generic (PLEG): container finished" podID="028404bc-6452-4d60-8962-cd8f899f8fdf" containerID="1c612178dfe0a1dc4375f3d9e21ef78236070b836a53cc2da73205d66a6f7554" exitCode=0 Sep 07 12:35:04.761924 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:04.761314 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" event={"ID":"028404bc-6452-4d60-8962-cd8f899f8fdf","Type":"ContainerDied","Data":"1c612178dfe0a1dc4375f3d9e21ef78236070b836a53cc2da73205d66a6f7554"} Sep 07 12:35:04.763210 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:04.763175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rx2cm" event={"ID":"b77a1de5-5ad1-4adf-b4f5-579ac0bc5429","Type":"ContainerStarted","Data":"b6db6b466416315583574ae887817989d65da31aa6c97fc9a57eebe6642a0b4c"} Sep 07 12:35:05.769940 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:05.769901 2558 generic.go:356] "Generic (PLEG): container finished" podID="028404bc-6452-4d60-8962-cd8f899f8fdf" containerID="00f9cf1d84765e93c494e44f963b0d181efbcc4c76919ad8d5dc87ddf8778012" exitCode=0 Sep 07 12:35:05.770476 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:05.769977 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" event={"ID":"028404bc-6452-4d60-8962-cd8f899f8fdf","Type":"ContainerDied","Data":"00f9cf1d84765e93c494e44f963b0d181efbcc4c76919ad8d5dc87ddf8778012"} Sep 07 12:35:06.184192 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:06.184150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:06.184397 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:06.184249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:06.184397 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:06.184293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:06.184397 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:06.184326 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:35:06.184582 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:06.184408 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:10.184385761 +0000 UTC m=+42.109826047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:35:06.184582 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:06.184408 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:06.184582 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:06.184440 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:10.184432545 +0000 UTC m=+42.109872827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:35:06.184582 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:06.184410 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:35:06.184582 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:06.184459 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:35:06.184582 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:06.184504 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:35:10.184478471 +0000 UTC m=+42.109918759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:35:06.775180 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:06.775145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" event={"ID":"028404bc-6452-4d60-8962-cd8f899f8fdf","Type":"ContainerStarted","Data":"96010c72e8e663749bfc504956d7ca35470366599325d3611c8c5c4804c89c3c"} Sep 07 12:35:06.802369 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:06.802323 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cjqkf" podStartSLOduration=7.851271349 podStartE2EDuration="38.802306365s" totalImagesPullingTime="30.951035016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:35:06.800876384 +0000 UTC m=+38.726316707" watchObservedRunningTime="2026-09-07 12:35:06.802306365 +0000 UTC m=+38.727746669" Sep 07 12:35:07.779536 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:07.779497 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rx2cm" event={"ID":"b77a1de5-5ad1-4adf-b4f5-579ac0bc5429","Type":"ContainerStarted","Data":"863c57117860e37514756f60927296ec9730a1aebf568ff768d7d62b282b4f68"} Sep 07 12:35:07.794969 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:07.794922 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rx2cm" podStartSLOduration=3.233926287 podStartE2EDuration="5.794907498s" totalImagesPullingTime="2.560981211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:35:07.794362881 +0000 UTC m=+39.719803185" watchObservedRunningTime="2026-09-07 12:35:07.794907498 +0000 UTC m=+39.720347831" Sep 07 12:35:10.213428 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:10.213387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:10.213428 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:10.213433 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:10.213864 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:10.213462 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:10.213864 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:10.213565 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:35:10.213864 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:10.213569 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:10.213864 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:10.213614 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:18.213600549 +0000 UTC m=+50.139040834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:35:10.213864 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:10.213572 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:35:10.213864 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:10.213627 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:18.213620961 +0000 UTC m=+50.139061242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:35:10.213864 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:10.213632 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:35:10.213864 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:10.213667 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:35:18.213653391 +0000 UTC m=+50.139093680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:35:18.273525 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:18.273462 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:18.273554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:18.273631 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:18.273641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:18.273696 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:34.273678144 +0000 UTC m=+66.199118438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:18.273702 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:18.273730 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:18.273744 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:18.273772 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:34.27374596 +0000 UTC m=+66.199186248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:35:18.274001 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:18.273789 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:35:34.273780091 +0000 UTC m=+66.199220373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:35:27.749829 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:27.749802 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b7xfc" Sep 07 12:35:33.282911 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.282867 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:35:33.285519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.285500 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 12:35:33.293347 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:33.293327 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 12:35:33.293398 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:33.293388 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:36:37.293369998 +0000 UTC m=+129.218810293 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : secret "metrics-daemon-secret" not found Sep 07 12:35:33.383836 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.383789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:35:33.383994 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.383858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:35:33.386318 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.386299 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 12:35:33.386383 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.386368 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 12:35:33.396734 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.396703 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 12:35:33.398089 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.398066 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/925c9026-83d4-4471-a185-8b600a58492a-original-pull-secret\") pod \"global-pull-secret-syncer-5zjc4\" (UID: \"925c9026-83d4-4471-a185-8b600a58492a\") " pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:35:33.407735 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.407705 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9hcv\" (UniqueName: \"kubernetes.io/projected/9b246143-b890-4fcb-bc09-70276a79f00d-kube-api-access-w9hcv\") pod \"network-check-target-9zw99\" (UID: \"9b246143-b890-4fcb-bc09-70276a79f00d\") " pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:35:33.495962 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.495915 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zjc4" Sep 07 12:35:33.503844 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.503825 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-npxpb\"" Sep 07 12:35:33.511754 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.511729 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:35:33.767905 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.767871 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5zjc4"] Sep 07 12:35:33.770840 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:35:33.770809 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925c9026_83d4_4471_a185_8b600a58492a.slice/crio-6914e2bf37d713e7f1f1ce93da5057b73130a07112a743640fd9c6acd986fd2b WatchSource:0}: Error finding container 6914e2bf37d713e7f1f1ce93da5057b73130a07112a743640fd9c6acd986fd2b: Status 404 returned error can't find the container with id 6914e2bf37d713e7f1f1ce93da5057b73130a07112a743640fd9c6acd986fd2b Sep 07 12:35:33.791629 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.791605 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9zw99"] Sep 07 12:35:33.794246 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:35:33.794218 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b246143_b890_4fcb_bc09_70276a79f00d.slice/crio-5c7c2bc2d0e9f0d979ae07c5b6c7867ec55ab95dfb6d6731396e3d649fc0fa11 WatchSource:0}: Error finding container 5c7c2bc2d0e9f0d979ae07c5b6c7867ec55ab95dfb6d6731396e3d649fc0fa11: Status 404 returned error can't find the container with id 5c7c2bc2d0e9f0d979ae07c5b6c7867ec55ab95dfb6d6731396e3d649fc0fa11 Sep 07 12:35:33.841163 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.841129 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9zw99" event={"ID":"9b246143-b890-4fcb-bc09-70276a79f00d","Type":"ContainerStarted","Data":"5c7c2bc2d0e9f0d979ae07c5b6c7867ec55ab95dfb6d6731396e3d649fc0fa11"} Sep 07 12:35:33.842266 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:33.842244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5zjc4" event={"ID":"925c9026-83d4-4471-a185-8b600a58492a","Type":"ContainerStarted","Data":"6914e2bf37d713e7f1f1ce93da5057b73130a07112a743640fd9c6acd986fd2b"} Sep 07 12:35:34.290450 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:34.290403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:35:34.290450 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:34.290457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:35:34.290890 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:34.290496 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:35:34.290890 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:34.290588 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:35:34.290890 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:34.290589 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:34.290890 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:34.290635 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:36:06.290622015 +0000 UTC m=+98.216062297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:35:34.290890 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:34.290653 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:36:06.290640112 +0000 UTC m=+98.216080397 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:35:34.290890 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:34.290592 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:35:34.290890 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:34.290666 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:35:34.290890 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:35:34.290693 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:36:06.290683546 +0000 UTC m=+98.216123831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:35:39.859781 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:39.859691 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9zw99" event={"ID":"9b246143-b890-4fcb-bc09-70276a79f00d","Type":"ContainerStarted","Data":"bce65f5a85751a3e5c81d244b5afb0837643ccf5cf10c567e0bd1fb3f5112f61"} Sep 07 12:35:39.860178 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:39.859793 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:35:39.861124 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:39.861099 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5zjc4" event={"ID":"925c9026-83d4-4471-a185-8b600a58492a","Type":"ContainerStarted","Data":"2470ea7a62d1bce7e4c89b08746df1d2fa09530ffff8a0d3b6b2c72c20ef4b31"} Sep 07 12:35:39.875314 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:39.875271 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9zw99" podStartSLOduration=66.250765001 podStartE2EDuration="1m11.875258088s" totalImagesPullingTime="5.624493087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:35:39.874046268 +0000 UTC m=+71.799486571" watchObservedRunningTime="2026-09-07 12:35:39.875258088 +0000 UTC m=+71.800698383" Sep 07 12:35:39.887295 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:39.887252 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5zjc4" podStartSLOduration=65.248817127 podStartE2EDuration="1m10.88724062s" totalImagesPullingTime="5.638423493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:35:39.887045293 +0000 UTC m=+71.812485599" watchObservedRunningTime="2026-09-07 12:35:39.88724062 +0000 UTC m=+71.812680923" Sep 07 12:35:59.109721 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.109591 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k"] Sep 07 12:35:59.113821 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.113796 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" Sep 07 12:35:59.116336 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.116307 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xhnsd\"" Sep 07 12:35:59.116336 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.116325 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 07 12:35:59.117027 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.117008 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 07 12:35:59.117121 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.117013 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 07 12:35:59.117315 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.117300 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 07 12:35:59.120281 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.120156 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k"] Sep 07 12:35:59.173060 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.173024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a317e817-c6d3-4d17-ba33-7912a93588fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66c979d7b4-xlv5k\" (UID: \"a317e817-c6d3-4d17-ba33-7912a93588fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" Sep 07 12:35:59.173199 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.173070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gndhw\" (UniqueName: \"kubernetes.io/projected/a317e817-c6d3-4d17-ba33-7912a93588fd-kube-api-access-gndhw\") pod \"managed-serviceaccount-addon-agent-66c979d7b4-xlv5k\" (UID: \"a317e817-c6d3-4d17-ba33-7912a93588fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" Sep 07 12:35:59.273926 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.273890 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a317e817-c6d3-4d17-ba33-7912a93588fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66c979d7b4-xlv5k\" (UID: \"a317e817-c6d3-4d17-ba33-7912a93588fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" Sep 07 12:35:59.273926 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.273925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gndhw\" (UniqueName: \"kubernetes.io/projected/a317e817-c6d3-4d17-ba33-7912a93588fd-kube-api-access-gndhw\") pod \"managed-serviceaccount-addon-agent-66c979d7b4-xlv5k\" (UID: \"a317e817-c6d3-4d17-ba33-7912a93588fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" Sep 07 12:35:59.276567 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.276539 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a317e817-c6d3-4d17-ba33-7912a93588fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66c979d7b4-xlv5k\" (UID: \"a317e817-c6d3-4d17-ba33-7912a93588fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" Sep 07 12:35:59.281892 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.281868 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gndhw\" (UniqueName: \"kubernetes.io/projected/a317e817-c6d3-4d17-ba33-7912a93588fd-kube-api-access-gndhw\") pod \"managed-serviceaccount-addon-agent-66c979d7b4-xlv5k\" (UID: \"a317e817-c6d3-4d17-ba33-7912a93588fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" Sep 07 12:35:59.432563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.432531 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" Sep 07 12:35:59.700036 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.699953 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k"] Sep 07 12:35:59.703586 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:35:59.703546 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda317e817_c6d3_4d17_ba33_7912a93588fd.slice/crio-7183b2502ab2b816692a12e86573a8e886e328abf4629f13f66d2428cdf0ec13 WatchSource:0}: Error finding container 7183b2502ab2b816692a12e86573a8e886e328abf4629f13f66d2428cdf0ec13: Status 404 returned error can't find the container with id 7183b2502ab2b816692a12e86573a8e886e328abf4629f13f66d2428cdf0ec13 Sep 07 12:35:59.911622 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:35:59.911588 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" event={"ID":"a317e817-c6d3-4d17-ba33-7912a93588fd","Type":"ContainerStarted","Data":"7183b2502ab2b816692a12e86573a8e886e328abf4629f13f66d2428cdf0ec13"} Sep 07 12:36:02.921576 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:36:02.921538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" event={"ID":"a317e817-c6d3-4d17-ba33-7912a93588fd","Type":"ContainerStarted","Data":"1cc052322404cf954af54ea227ff07873a77a8fa7f263687c53067ff5efed72b"} Sep 07 12:36:02.940078 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:36:02.940033 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" podStartSLOduration=1.444589272 podStartE2EDuration="3.940017762s" totalImagesPullingTime="2.49542849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:36:02.940007373 +0000 UTC m=+94.865447677" watchObservedRunningTime="2026-09-07 12:36:02.940017762 +0000 UTC m=+94.865458066" Sep 07 12:36:06.323351 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:36:06.323253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:36:06.323351 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:36:06.323310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:36:06.323351 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:36:06.323336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:36:06.323863 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:06.323412 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:36:06.323863 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:06.323435 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:36:06.323863 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:06.323413 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:36:06.323863 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:06.323474 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:36:06.323863 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:06.323480 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:37:10.323463139 +0000 UTC m=+162.248903425 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:36:06.323863 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:06.323524 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:37:10.323510662 +0000 UTC m=+162.248950948 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:36:06.323863 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:06.323536 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:37:10.323530656 +0000 UTC m=+162.248970938 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:36:10.866346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:36:10.866317 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9zw99" Sep 07 12:36:37.348122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:36:37.348080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:36:37.348612 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:37.348191 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 12:36:37.348612 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:36:37.348245 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:38:39.348231919 +0000 UTC m=+251.273672201 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : secret "metrics-daemon-secret" not found Sep 07 12:37:05.431732 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:05.431674 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" Sep 07 12:37:05.445792 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:05.445756 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" podUID="5f290dd5-53c4-4b6b-bdaa-668ba1ab7862" Sep 07 12:37:05.470480 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:05.470454 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fzrtk" podUID="3541b899-1ac1-4abb-8289-b30e578e1864" Sep 07 12:37:06.076793 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:37:06.076761 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:37:06.076910 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:37:06.076761 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzrtk" Sep 07 12:37:06.593370 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:06.593329 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:37:10.364430 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:37:10.364385 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:37:10.364430 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:37:10.364438 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:37:10.364925 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:37:10.364567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:37:10.364925 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:10.364586 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:37:10.364925 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:10.364666 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bf4547d5b-d4n62: secret "image-registry-tls" not found Sep 07 12:37:10.364925 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:10.364667 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:37:10.364925 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:10.364715 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls podName:36f5b992-4259-4a13-a46f-d0b96838abeb nodeName:}" failed. No retries permitted until 2026-09-07 12:39:12.364699084 +0000 UTC m=+284.290139367 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls") pod "image-registry-bf4547d5b-d4n62" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb") : secret "image-registry-tls" not found Sep 07 12:37:10.364925 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:10.364648 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:37:10.364925 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:10.364735 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:12.364723121 +0000 UTC m=+284.290163403 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:37:10.364925 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:37:10.364776 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls podName:3541b899-1ac1-4abb-8289-b30e578e1864 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:12.364757185 +0000 UTC m=+284.290197470 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls") pod "dns-default-fzrtk" (UID: "3541b899-1ac1-4abb-8289-b30e578e1864") : secret "dns-default-metrics-tls" not found Sep 07 12:37:19.584231 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:37:19.584187 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:37:20.583371 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:37:20.583333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:38:03.216290 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:03.216254 2558 generic.go:356] "Generic (PLEG): container finished" podID="a317e817-c6d3-4d17-ba33-7912a93588fd" containerID="1cc052322404cf954af54ea227ff07873a77a8fa7f263687c53067ff5efed72b" exitCode=255 Sep 07 12:38:03.216796 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:03.216329 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" event={"ID":"a317e817-c6d3-4d17-ba33-7912a93588fd","Type":"ContainerDied","Data":"1cc052322404cf954af54ea227ff07873a77a8fa7f263687c53067ff5efed72b"} Sep 07 12:38:03.221826 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:03.221808 2558 scope.go:117] "RemoveContainer" containerID="1cc052322404cf954af54ea227ff07873a77a8fa7f263687c53067ff5efed72b" Sep 07 12:38:04.220230 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:04.220193 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66c979d7b4-xlv5k" event={"ID":"a317e817-c6d3-4d17-ba33-7912a93588fd","Type":"ContainerStarted","Data":"831135070a2737a90e9cd976c0a02af06a7e1a3c30169c6ebf00a2c7ddb6e080"} Sep 07 12:38:39.414133 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:39.414077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:38:39.414665 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:39.414223 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 12:38:39.414665 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:39.414300 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs podName:5e722016-4e1c-4cd0-80cb-19d044cc821e nodeName:}" failed. No retries permitted until 2026-09-07 12:40:41.41428251 +0000 UTC m=+373.339722791 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs") pod "network-metrics-daemon-p8mnv" (UID: "5e722016-4e1c-4cd0-80cb-19d044cc821e") : secret "metrics-daemon-secret" not found Sep 07 12:38:54.232180 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.232086 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl"] Sep 07 12:38:54.235014 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.234993 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.237449 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.237428 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 07 12:38:54.237806 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.237774 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl"] Sep 07 12:38:54.238161 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.238129 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 07 12:38:54.238267 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.238159 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6gmxr\"" Sep 07 12:38:54.238267 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.238215 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:38:54.238528 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.238512 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 07 12:38:54.322785 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.322752 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9"] Sep 07 12:38:54.325541 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.325517 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.327037 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.327015 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg"] Sep 07 12:38:54.327204 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.327185 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-config\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.327255 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.327228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h98d4\" (UniqueName: \"kubernetes.io/projected/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-kube-api-access-h98d4\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.327324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.327307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-serving-cert\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.328158 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.328132 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 12:38:54.328265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.328159 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 12:38:54.328414 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.328401 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9qd8r\"" Sep 07 12:38:54.328854 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.328838 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 07 12:38:54.329833 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.329787 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 07 12:38:54.329928 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.329819 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d7c6d8f9b-2nx8t"] Sep 07 12:38:54.329928 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.329887 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:54.331771 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.331754 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 07 12:38:54.332183 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.332043 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z2rdg\"" Sep 07 12:38:54.332183 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.332068 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:38:54.332183 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.332067 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 07 12:38:54.332607 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.332589 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.334554 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.334537 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 07 12:38:54.334649 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.334572 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 07 12:38:54.334649 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.334581 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xrztm\"" Sep 07 12:38:54.334829 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.334813 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 07 12:38:54.335024 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.335010 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 07 12:38:54.335067 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.335012 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 07 12:38:54.335067 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.335047 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 07 12:38:54.343065 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.343045 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9"] Sep 07 12:38:54.344917 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.344896 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d7c6d8f9b-2nx8t"] Sep 07 12:38:54.355837 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.355816 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg"] Sep 07 12:38:54.422575 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.422543 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-nrslh"] Sep 07 12:38:54.425372 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.425356 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.427693 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-stats-auth\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.427814 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427696 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5thnm\" (UniqueName: \"kubernetes.io/projected/c4ff4f17-8123-40fc-b26d-9663f69d2f98-kube-api-access-5thnm\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.427814 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-default-certificate\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.427814 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.427814 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-serving-cert\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.427955 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.427955 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427849 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-config\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.427955 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h98d4\" (UniqueName: \"kubernetes.io/projected/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-kube-api-access-h98d4\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.427955 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0ef95456-5e64-4bed-ad23-4524a2ed98c9-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.427955 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjj74\" (UniqueName: \"kubernetes.io/projected/307daee3-549f-4e21-8abd-0d6ac07d805b-kube-api-access-xjj74\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:54.428165 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.427979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc26w\" (UniqueName: \"kubernetes.io/projected/0ef95456-5e64-4bed-ad23-4524a2ed98c9-kube-api-access-zc26w\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.428165 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.428022 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:54.428244 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.428161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.428372 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.428354 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-config\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.428863 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.428847 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 07 12:38:54.429236 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.429215 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 07 12:38:54.429322 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.429277 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 12:38:54.429380 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.429351 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 12:38:54.429553 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.429534 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7fhqm\"" Sep 07 12:38:54.430138 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.430118 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-serving-cert\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.434310 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.434291 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 07 12:38:54.441474 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.441450 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-nrslh"] Sep 07 12:38:54.446917 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.446895 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h98d4\" (UniqueName: \"kubernetes.io/projected/825b7c6f-bea9-4f0c-96cd-feedb27fb12b-kube-api-access-h98d4\") pod \"service-ca-operator-859f94c4b-dfrxl\" (UID: \"825b7c6f-bea9-4f0c-96cd-feedb27fb12b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.529234 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.529234 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-stats-auth\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.529234 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5thnm\" (UniqueName: \"kubernetes.io/projected/c4ff4f17-8123-40fc-b26d-9663f69d2f98-kube-api-access-5thnm\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.529234 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-default-certificate\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.529234 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.529617 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:54.529319 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:38:54.529617 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:54.529373 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:55.029353318 +0000 UTC m=+266.954793602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : configmap references non-existent config key: service-ca.crt Sep 07 12:38:54.529617 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.529617 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2743122-2067-4c75-91e6-6187927e3b59-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.529617 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:54.529462 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls podName:0ef95456-5e64-4bed-ad23-4524a2ed98c9 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:55.029438556 +0000 UTC m=+266.954878843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sz6w9" (UID: "0ef95456-5e64-4bed-ad23-4524a2ed98c9") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:38:54.529617 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:54.529479 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:38:54.529617 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:54.529558 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:55.029546078 +0000 UTC m=+266.954986363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : secret "router-metrics-certs-default" not found Sep 07 12:38:54.529617 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0ef95456-5e64-4bed-ad23-4524a2ed98c9-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjj74\" (UniqueName: \"kubernetes.io/projected/307daee3-549f-4e21-8abd-0d6ac07d805b-kube-api-access-xjj74\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529679 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2743122-2067-4c75-91e6-6187927e3b59-tmp\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2743122-2067-4c75-91e6-6187927e3b59-snapshots\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2743122-2067-4c75-91e6-6187927e3b59-serving-cert\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc26w\" (UniqueName: \"kubernetes.io/projected/0ef95456-5e64-4bed-ad23-4524a2ed98c9-kube-api-access-zc26w\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529892 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8kd\" (UniqueName: \"kubernetes.io/projected/b2743122-2067-4c75-91e6-6187927e3b59-kube-api-access-gb8kd\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.529933 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2743122-2067-4c75-91e6-6187927e3b59-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.529965 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:54.529962 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:38:54.530249 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:54.530020 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls podName:307daee3-549f-4e21-8abd-0d6ac07d805b nodeName:}" failed. No retries permitted until 2026-09-07 12:38:55.030004879 +0000 UTC m=+266.955445162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-j2sgg" (UID: "307daee3-549f-4e21-8abd-0d6ac07d805b") : secret "samples-operator-tls" not found Sep 07 12:38:54.530316 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.530297 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0ef95456-5e64-4bed-ad23-4524a2ed98c9-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.531755 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.531729 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-stats-auth\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.531853 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.531764 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-default-certificate\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.538508 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.538467 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5thnm\" (UniqueName: \"kubernetes.io/projected/c4ff4f17-8123-40fc-b26d-9663f69d2f98-kube-api-access-5thnm\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:54.538680 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.538657 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc26w\" (UniqueName: \"kubernetes.io/projected/0ef95456-5e64-4bed-ad23-4524a2ed98c9-kube-api-access-zc26w\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:54.539852 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.539829 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjj74\" (UniqueName: \"kubernetes.io/projected/307daee3-549f-4e21-8abd-0d6ac07d805b-kube-api-access-xjj74\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:54.545498 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.545463 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" Sep 07 12:38:54.630739 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.630706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8kd\" (UniqueName: \"kubernetes.io/projected/b2743122-2067-4c75-91e6-6187927e3b59-kube-api-access-gb8kd\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.630871 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.630745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2743122-2067-4c75-91e6-6187927e3b59-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.630941 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.630920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2743122-2067-4c75-91e6-6187927e3b59-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.631002 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.630990 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2743122-2067-4c75-91e6-6187927e3b59-tmp\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.631043 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.631011 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2743122-2067-4c75-91e6-6187927e3b59-snapshots\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.631043 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.631029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2743122-2067-4c75-91e6-6187927e3b59-serving-cert\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.631349 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.631330 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2743122-2067-4c75-91e6-6187927e3b59-tmp\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.631469 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.631446 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2743122-2067-4c75-91e6-6187927e3b59-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.631634 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.631617 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b2743122-2067-4c75-91e6-6187927e3b59-snapshots\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.631766 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.631749 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2743122-2067-4c75-91e6-6187927e3b59-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.633198 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.633183 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2743122-2067-4c75-91e6-6187927e3b59-serving-cert\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.640358 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.640342 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8kd\" (UniqueName: \"kubernetes.io/projected/b2743122-2067-4c75-91e6-6187927e3b59-kube-api-access-gb8kd\") pod \"insights-operator-76bcd6ccf5-nrslh\" (UID: \"b2743122-2067-4c75-91e6-6187927e3b59\") " pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.739229 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.739201 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" Sep 07 12:38:54.815513 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:54.815471 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl"] Sep 07 12:38:54.817878 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:38:54.817852 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825b7c6f_bea9_4f0c_96cd_feedb27fb12b.slice/crio-4c22f55458130e344ff58f88d4754017ff0c1066fdb9ddc05ea164446f6afc5f WatchSource:0}: Error finding container 4c22f55458130e344ff58f88d4754017ff0c1066fdb9ddc05ea164446f6afc5f: Status 404 returned error can't find the container with id 4c22f55458130e344ff58f88d4754017ff0c1066fdb9ddc05ea164446f6afc5f Sep 07 12:38:55.006600 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:55.006568 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-nrslh"] Sep 07 12:38:55.009143 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:38:55.009121 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2743122_2067_4c75_91e6_6187927e3b59.slice/crio-b2b486eed5383f40cff996aa9a1e998fe44c9b0381caf5cf5e88b654d567bd67 WatchSource:0}: Error finding container b2b486eed5383f40cff996aa9a1e998fe44c9b0381caf5cf5e88b654d567bd67: Status 404 returned error can't find the container with id b2b486eed5383f40cff996aa9a1e998fe44c9b0381caf5cf5e88b654d567bd67 Sep 07 12:38:55.034638 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:55.034583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:55.034721 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:55.034668 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:55.034768 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:55.034719 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:55.034768 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:55.034730 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:38:55.034768 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:55.034754 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:55.034901 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:55.034784 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:56.034767255 +0000 UTC m=+267.960207541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : secret "router-metrics-certs-default" not found Sep 07 12:38:55.034901 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:55.034805 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:38:55.034901 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:55.034828 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:56.034818061 +0000 UTC m=+267.960258346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : configmap references non-existent config key: service-ca.crt Sep 07 12:38:55.034901 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:55.034853 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls podName:307daee3-549f-4e21-8abd-0d6ac07d805b nodeName:}" failed. No retries permitted until 2026-09-07 12:38:56.034839549 +0000 UTC m=+267.960279831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-j2sgg" (UID: "307daee3-549f-4e21-8abd-0d6ac07d805b") : secret "samples-operator-tls" not found Sep 07 12:38:55.034901 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:55.034885 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:38:55.035124 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:55.034946 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls podName:0ef95456-5e64-4bed-ad23-4524a2ed98c9 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:56.034930593 +0000 UTC m=+267.960370906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sz6w9" (UID: "0ef95456-5e64-4bed-ad23-4524a2ed98c9") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:38:55.341635 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:55.341549 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" event={"ID":"b2743122-2067-4c75-91e6-6187927e3b59","Type":"ContainerStarted","Data":"b2b486eed5383f40cff996aa9a1e998fe44c9b0381caf5cf5e88b654d567bd67"} Sep 07 12:38:55.342543 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:55.342516 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" event={"ID":"825b7c6f-bea9-4f0c-96cd-feedb27fb12b","Type":"ContainerStarted","Data":"4c22f55458130e344ff58f88d4754017ff0c1066fdb9ddc05ea164446f6afc5f"} Sep 07 12:38:56.043985 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:56.043935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:56.044158 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:56.044035 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:56.044158 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:56.044070 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:56.044158 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:56.044092 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:38:56.044158 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:56.044116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:56.044158 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:56.044153 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls podName:307daee3-549f-4e21-8abd-0d6ac07d805b nodeName:}" failed. No retries permitted until 2026-09-07 12:38:58.044138265 +0000 UTC m=+269.969578547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-j2sgg" (UID: "307daee3-549f-4e21-8abd-0d6ac07d805b") : secret "samples-operator-tls" not found Sep 07 12:38:56.044336 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:56.044190 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:38:56.044336 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:56.044210 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:38:56.044336 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:56.044262 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls podName:0ef95456-5e64-4bed-ad23-4524a2ed98c9 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:58.044245394 +0000 UTC m=+269.969685708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sz6w9" (UID: "0ef95456-5e64-4bed-ad23-4524a2ed98c9") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:38:56.044336 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:56.044277 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:58.044271104 +0000 UTC m=+269.969711386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : configmap references non-existent config key: service-ca.crt Sep 07 12:38:56.044336 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:56.044289 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:58.044283412 +0000 UTC m=+269.969723694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : secret "router-metrics-certs-default" not found Sep 07 12:38:58.062148 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:58.062112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:58.062224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:58.062295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:58.062298 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:58.062333 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:58.062370 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:02.062352626 +0000 UTC m=+273.987792908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : secret "router-metrics-certs-default" not found Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:58.062393 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:58.062443 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:02.062425733 +0000 UTC m=+273.987866016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : configmap references non-existent config key: service-ca.crt Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:58.062461 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:58.062464 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls podName:307daee3-549f-4e21-8abd-0d6ac07d805b nodeName:}" failed. No retries permitted until 2026-09-07 12:39:02.062453602 +0000 UTC m=+273.987893885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-j2sgg" (UID: "307daee3-549f-4e21-8abd-0d6ac07d805b") : secret "samples-operator-tls" not found Sep 07 12:38:58.062650 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:38:58.062531 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls podName:0ef95456-5e64-4bed-ad23-4524a2ed98c9 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:02.062516791 +0000 UTC m=+273.987957086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sz6w9" (UID: "0ef95456-5e64-4bed-ad23-4524a2ed98c9") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:38:59.355207 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.355168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" event={"ID":"b2743122-2067-4c75-91e6-6187927e3b59","Type":"ContainerStarted","Data":"5ba8d76f33cb19998aa2cd9f56321de402d2347dcbb764643bcbc5da7ba846b7"} Sep 07 12:38:59.356827 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.356783 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" event={"ID":"825b7c6f-bea9-4f0c-96cd-feedb27fb12b","Type":"ContainerStarted","Data":"b54aa06114a62529233ed4935dc632ee570d7e645a2fe62fc621c8c842d74066"} Sep 07 12:38:59.371902 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.371852 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" podStartSLOduration=1.74217524 podStartE2EDuration="5.371836688s" totalImagesPullingTime="3.629661448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:38:59.370835732 +0000 UTC m=+271.296276040" watchObservedRunningTime="2026-09-07 12:38:59.371836688 +0000 UTC m=+271.297276989" Sep 07 12:38:59.390006 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.389944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" podStartSLOduration=1.570209077 podStartE2EDuration="5.389923688s" totalImagesPullingTime="3.819714611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:38:59.388380041 +0000 UTC m=+271.313820366" watchObservedRunningTime="2026-09-07 12:38:59.389923688 +0000 UTC m=+271.315363993" Sep 07 12:38:59.921937 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.921892 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8tsk2"] Sep 07 12:38:59.926256 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.926232 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:38:59.929866 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.929839 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 12:38:59.929983 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.929867 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxwzv\"" Sep 07 12:38:59.930068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.930034 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 12:38:59.938301 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:38:59.938275 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8tsk2"] Sep 07 12:39:00.083261 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.083219 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a89c85a-e8a7-4711-8b42-c368f0521ca8-crio-socket\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.083261 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.083266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.083465 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.083335 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a89c85a-e8a7-4711-8b42-c368f0521ca8-data-volume\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.083465 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.083365 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbklv\" (UniqueName: \"kubernetes.io/projected/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-api-access-zbklv\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.083465 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.083386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.184637 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.184556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a89c85a-e8a7-4711-8b42-c368f0521ca8-crio-socket\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.184637 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.184594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.184637 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.184633 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a89c85a-e8a7-4711-8b42-c368f0521ca8-data-volume\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.184907 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.184656 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbklv\" (UniqueName: \"kubernetes.io/projected/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-api-access-zbklv\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.184907 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.184674 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.184907 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.184691 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a89c85a-e8a7-4711-8b42-c368f0521ca8-crio-socket\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.184907 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:00.184761 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:00.184907 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:00.184798 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:00.184907 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:00.184817 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:00.684801642 +0000 UTC m=+272.610241923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : configmap "kube-rbac-proxy" not found Sep 07 12:39:00.184907 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:00.184848 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:00.684832181 +0000 UTC m=+272.610272466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:00.185156 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.184972 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a89c85a-e8a7-4711-8b42-c368f0521ca8-data-volume\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.193309 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.193277 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbklv\" (UniqueName: \"kubernetes.io/projected/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-api-access-zbklv\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.688022 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.687990 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.688396 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:00.688054 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:00.688396 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:00.688124 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:00.688396 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:00.688136 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:00.688396 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:00.688183 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:01.68816745 +0000 UTC m=+273.613607751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : configmap "kube-rbac-proxy" not found Sep 07 12:39:00.688396 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:00.688196 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:01.688189925 +0000 UTC m=+273.613630206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:01.695305 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:01.695268 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:01.695731 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:01.695364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:01.695731 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:01.695425 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:01.695731 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:01.695512 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:03.695472181 +0000 UTC m=+275.620912477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:01.695731 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:01.695535 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:01.696052 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:01.696022 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:03.695991293 +0000 UTC m=+275.621431599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : configmap "kube-rbac-proxy" not found Sep 07 12:39:02.090727 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:02.090654 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lm4z6_ef377deb-47f7-4251-b74c-d3e770cdc31a/dns-node-resolver/0.log" Sep 07 12:39:02.099026 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:02.098995 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:39:02.099153 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:02.099058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:39:02.099153 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:02.099095 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:02.099153 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:02.099146 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:39:02.099307 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:02.099151 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:02.099307 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:02.099215 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls podName:307daee3-549f-4e21-8abd-0d6ac07d805b nodeName:}" failed. No retries permitted until 2026-09-07 12:39:10.099199822 +0000 UTC m=+282.024640103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-j2sgg" (UID: "307daee3-549f-4e21-8abd-0d6ac07d805b") : secret "samples-operator-tls" not found Sep 07 12:39:02.099307 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:02.099146 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:39:02.099307 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:02.099225 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:39:02.099307 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:02.099252 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:10.099236456 +0000 UTC m=+282.024676741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : configmap references non-existent config key: service-ca.crt Sep 07 12:39:02.099307 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:02.099278 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls podName:0ef95456-5e64-4bed-ad23-4524a2ed98c9 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:10.099266815 +0000 UTC m=+282.024707102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sz6w9" (UID: "0ef95456-5e64-4bed-ad23-4524a2ed98c9") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:39:02.099307 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:02.099298 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:10.099287499 +0000 UTC m=+282.024727787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : secret "router-metrics-certs-default" not found Sep 07 12:39:02.690384 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:02.690355 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lnp54_ea852cfd-9f11-41eb-9526-90abd8e907b2/node-ca/0.log" Sep 07 12:39:03.689841 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:03.689812 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rx2cm_b77a1de5-5ad1-4adf-b4f5-579ac0bc5429/serve-healthcheck-canary/0.log" Sep 07 12:39:03.713356 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:03.713326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:03.713525 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:03.713409 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:03.713607 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:03.713552 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:03.713607 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:03.713577 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:03.713708 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:03.713631 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:07.713608876 +0000 UTC m=+279.639049169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:03.713708 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:03.713653 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:07.713642279 +0000 UTC m=+279.639082578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : configmap "kube-rbac-proxy" not found Sep 07 12:39:07.745552 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:07.745510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:07.745945 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:07.745603 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:07.745945 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:07.745662 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:07.745945 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:07.745729 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:15.745712386 +0000 UTC m=+287.671152684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:07.745945 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:07.745736 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:07.745945 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:07.745789 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:15.745774685 +0000 UTC m=+287.671215011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : configmap "kube-rbac-proxy" not found Sep 07 12:39:09.077273 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:09.077228 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fzrtk" podUID="3541b899-1ac1-4abb-8289-b30e578e1864" Sep 07 12:39:09.077273 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:09.077257 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" Sep 07 12:39:09.385816 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:09.385789 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:39:09.385976 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:09.385795 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzrtk" Sep 07 12:39:10.164948 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:10.164906 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:39:10.165446 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:10.164974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:39:10.165446 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:10.165008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:10.165446 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:10.165092 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:10.165446 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:10.165126 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:39:10.165446 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:10.165205 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls podName:0ef95456-5e64-4bed-ad23-4524a2ed98c9 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:26.165185723 +0000 UTC m=+298.090626009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sz6w9" (UID: "0ef95456-5e64-4bed-ad23-4524a2ed98c9") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:39:10.165446 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:10.165224 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:26.16521393 +0000 UTC m=+298.090654217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : configmap references non-existent config key: service-ca.crt Sep 07 12:39:10.165446 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:10.165226 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:39:10.165446 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:10.165270 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs podName:c4ff4f17-8123-40fc-b26d-9663f69d2f98 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:26.16525735 +0000 UTC m=+298.090697632 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs") pod "router-default-5d7c6d8f9b-2nx8t" (UID: "c4ff4f17-8123-40fc-b26d-9663f69d2f98") : secret "router-metrics-certs-default" not found Sep 07 12:39:10.167272 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:10.167238 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/307daee3-549f-4e21-8abd-0d6ac07d805b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-j2sgg\" (UID: \"307daee3-549f-4e21-8abd-0d6ac07d805b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:39:10.242148 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:10.242112 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" Sep 07 12:39:10.507925 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:10.507853 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg"] Sep 07 12:39:11.393427 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:11.393392 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" event={"ID":"307daee3-549f-4e21-8abd-0d6ac07d805b","Type":"ContainerStarted","Data":"4f176aa791497a60c09a981cc614e87e54f71123cf1b4c0dd7cdf9fb8fb2f0c6"} Sep 07 12:39:12.384887 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.384855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:39:12.385053 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.384903 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:39:12.385107 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.385083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:39:12.385199 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:12.385181 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:39:12.385274 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:12.385262 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert podName:5f290dd5-53c4-4b6b-bdaa-668ba1ab7862 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:14.385242092 +0000 UTC m=+406.310682386 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-k8mph" (UID: "5f290dd5-53c4-4b6b-bdaa-668ba1ab7862") : secret "networking-console-plugin-cert" not found Sep 07 12:39:12.387131 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.387107 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3541b899-1ac1-4abb-8289-b30e578e1864-metrics-tls\") pod \"dns-default-fzrtk\" (UID: \"3541b899-1ac1-4abb-8289-b30e578e1864\") " pod="openshift-dns/dns-default-fzrtk" Sep 07 12:39:12.387260 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.387242 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"image-registry-bf4547d5b-d4n62\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:39:12.398119 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.398096 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" event={"ID":"307daee3-549f-4e21-8abd-0d6ac07d805b","Type":"ContainerStarted","Data":"bc04fe71c3abad5952f6d14452b1b625c536aa93c4a307399f988835946c20cd"} Sep 07 12:39:12.398424 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.398142 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" event={"ID":"307daee3-549f-4e21-8abd-0d6ac07d805b","Type":"ContainerStarted","Data":"a1672ebe69aa048d0982ad51e6b899b970b73f07a9af50bdbb03b5d9613ba8b1"} Sep 07 12:39:12.414253 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.414214 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-j2sgg" podStartSLOduration=16.751838463 podStartE2EDuration="18.41420072s" totalImagesPullingTime="1.662362257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:12.413985353 +0000 UTC m=+284.339425657" watchObservedRunningTime="2026-09-07 12:39:12.41420072 +0000 UTC m=+284.339641023" Sep 07 12:39:12.689419 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.689392 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bfdzl\"" Sep 07 12:39:12.689591 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.689427 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nvqb4\"" Sep 07 12:39:12.698081 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.698062 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:39:12.698162 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.698143 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzrtk" Sep 07 12:39:12.975731 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.975645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fzrtk"] Sep 07 12:39:12.978182 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:12.978157 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bf4547d5b-d4n62"] Sep 07 12:39:12.978898 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:12.978872 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3541b899_1ac1_4abb_8289_b30e578e1864.slice/crio-857e69e74001582f205cb567dee1a21131a6f29e2e48558e95a69c5304e4064a WatchSource:0}: Error finding container 857e69e74001582f205cb567dee1a21131a6f29e2e48558e95a69c5304e4064a: Status 404 returned error can't find the container with id 857e69e74001582f205cb567dee1a21131a6f29e2e48558e95a69c5304e4064a Sep 07 12:39:12.982121 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:12.982092 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f5b992_4259_4a13_a46f_d0b96838abeb.slice/crio-a406627b3b6d0085595546a5404f9507a0026b162c459786f7f9717a5a88cea5 WatchSource:0}: Error finding container a406627b3b6d0085595546a5404f9507a0026b162c459786f7f9717a5a88cea5: Status 404 returned error can't find the container with id a406627b3b6d0085595546a5404f9507a0026b162c459786f7f9717a5a88cea5 Sep 07 12:39:13.403232 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:13.403199 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" event={"ID":"36f5b992-4259-4a13-a46f-d0b96838abeb","Type":"ContainerStarted","Data":"f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428"} Sep 07 12:39:13.403720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:13.403255 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" event={"ID":"36f5b992-4259-4a13-a46f-d0b96838abeb","Type":"ContainerStarted","Data":"a406627b3b6d0085595546a5404f9507a0026b162c459786f7f9717a5a88cea5"} Sep 07 12:39:13.403720 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:13.403307 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:39:13.404405 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:13.404380 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzrtk" event={"ID":"3541b899-1ac1-4abb-8289-b30e578e1864","Type":"ContainerStarted","Data":"857e69e74001582f205cb567dee1a21131a6f29e2e48558e95a69c5304e4064a"} Sep 07 12:39:13.424439 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:13.424391 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" podStartSLOduration=284.424376438 podStartE2EDuration="4m44.424376438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:13.423200294 +0000 UTC m=+285.348640612" watchObservedRunningTime="2026-09-07 12:39:13.424376438 +0000 UTC m=+285.349816742" Sep 07 12:39:15.412835 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:15.412801 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzrtk" event={"ID":"3541b899-1ac1-4abb-8289-b30e578e1864","Type":"ContainerStarted","Data":"b1edb8d8e54c7838f9cea034e9b1328a61bd05e33355afabf30698f715b50561"} Sep 07 12:39:15.413214 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:15.412851 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzrtk" event={"ID":"3541b899-1ac1-4abb-8289-b30e578e1864","Type":"ContainerStarted","Data":"0b7e90f3b44c6faad5245048ee10c9bfc40fe932226c24bc8efffca398887963"} Sep 07 12:39:15.413214 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:15.412956 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fzrtk" Sep 07 12:39:15.430630 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:15.430584 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fzrtk" podStartSLOduration=251.925092002 podStartE2EDuration="4m13.430569792s" totalImagesPullingTime="1.50547779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:15.430014097 +0000 UTC m=+287.355454429" watchObservedRunningTime="2026-09-07 12:39:15.430569792 +0000 UTC m=+287.356010095" Sep 07 12:39:15.813109 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:15.813017 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:15.813109 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:15.813086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:15.813308 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:15.813172 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:15.813308 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:15.813241 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls podName:7a89c85a-e8a7-4711-8b42-c368f0521ca8 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:31.813223844 +0000 UTC m=+303.738664137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tsk2" (UID: "7a89c85a-e8a7-4711-8b42-c368f0521ca8") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:15.813605 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:15.813588 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a89c85a-e8a7-4711-8b42-c368f0521ca8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:22.585389 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:22.585339 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p8mnv" podUID="5e722016-4e1c-4cd0-80cb-19d044cc821e" Sep 07 12:39:23.584520 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:23.584460 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" podUID="5f290dd5-53c4-4b6b-bdaa-668ba1ab7862" Sep 07 12:39:25.420601 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:25.420569 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fzrtk" Sep 07 12:39:26.195158 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.195109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:39:26.195158 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.195162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:26.195378 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.195201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:26.195926 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.195905 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ff4f17-8123-40fc-b26d-9663f69d2f98-service-ca-bundle\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:26.197639 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.197616 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef95456-5e64-4bed-ad23-4524a2ed98c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sz6w9\" (UID: \"0ef95456-5e64-4bed-ad23-4524a2ed98c9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:39:26.197688 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.197625 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4ff4f17-8123-40fc-b26d-9663f69d2f98-metrics-certs\") pod \"router-default-5d7c6d8f9b-2nx8t\" (UID: \"c4ff4f17-8123-40fc-b26d-9663f69d2f98\") " pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:26.435534 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.435457 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" Sep 07 12:39:26.447676 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.447616 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:26.711919 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.711838 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9"] Sep 07 12:39:26.716514 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:26.716464 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef95456_5e64_4bed_ad23_4524a2ed98c9.slice/crio-22b7b0676e9994fcc98b83f28c7d6ec5fc255c6fe48bedce5a7237bd674f81f1 WatchSource:0}: Error finding container 22b7b0676e9994fcc98b83f28c7d6ec5fc255c6fe48bedce5a7237bd674f81f1: Status 404 returned error can't find the container with id 22b7b0676e9994fcc98b83f28c7d6ec5fc255c6fe48bedce5a7237bd674f81f1 Sep 07 12:39:26.730875 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:26.730748 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d7c6d8f9b-2nx8t"] Sep 07 12:39:26.733037 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:26.733011 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ff4f17_8123_40fc_b26d_9663f69d2f98.slice/crio-194c853f3d36c0fa9e24cf5ff7f1429596a3651bd5b22d3b1f9b2f2474d3c215 WatchSource:0}: Error finding container 194c853f3d36c0fa9e24cf5ff7f1429596a3651bd5b22d3b1f9b2f2474d3c215: Status 404 returned error can't find the container with id 194c853f3d36c0fa9e24cf5ff7f1429596a3651bd5b22d3b1f9b2f2474d3c215 Sep 07 12:39:27.455383 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:27.455351 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" event={"ID":"c4ff4f17-8123-40fc-b26d-9663f69d2f98","Type":"ContainerStarted","Data":"0734977024c316750bd4631a5c3c48c882af9b32e8f734dfcbdb827960dcb338"} Sep 07 12:39:27.455867 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:27.455412 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" event={"ID":"c4ff4f17-8123-40fc-b26d-9663f69d2f98","Type":"ContainerStarted","Data":"194c853f3d36c0fa9e24cf5ff7f1429596a3651bd5b22d3b1f9b2f2474d3c215"} Sep 07 12:39:27.456714 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:27.456681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" event={"ID":"0ef95456-5e64-4bed-ad23-4524a2ed98c9","Type":"ContainerStarted","Data":"22b7b0676e9994fcc98b83f28c7d6ec5fc255c6fe48bedce5a7237bd674f81f1"} Sep 07 12:39:27.481949 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:27.481894 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" podStartSLOduration=33.48187258 podStartE2EDuration="33.48187258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:27.480578164 +0000 UTC m=+299.406018488" watchObservedRunningTime="2026-09-07 12:39:27.48187258 +0000 UTC m=+299.407312883" Sep 07 12:39:28.448538 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:28.448506 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:28.450866 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:28.450846 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:28.462179 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:28.462153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" event={"ID":"0ef95456-5e64-4bed-ad23-4524a2ed98c9","Type":"ContainerStarted","Data":"f49c80b7bfcfa166c2a8b48953d5ec43b585bc592cfdf2e8f9023f417104b282"} Sep 07 12:39:28.462610 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:28.462371 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:28.463458 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:28.463441 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d7c6d8f9b-2nx8t" Sep 07 12:39:28.484108 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:28.484059 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sz6w9" podStartSLOduration=32.809136328 podStartE2EDuration="34.484043613s" totalImagesPullingTime="1.674907285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:28.482569547 +0000 UTC m=+300.408009878" watchObservedRunningTime="2026-09-07 12:39:28.484043613 +0000 UTC m=+300.409483917" Sep 07 12:39:28.513475 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:28.513208 2558 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 12:39:30.989528 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:30.989494 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hw585"] Sep 07 12:39:31.002852 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.002822 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hw585"] Sep 07 12:39:31.002999 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.002934 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.005908 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.005868 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nf465\"" Sep 07 12:39:31.005908 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.005864 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 07 12:39:31.006122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.005916 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 07 12:39:31.006122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.005868 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 12:39:31.139578 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.139535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f211f38-f6d3-4bfe-b556-c3e418914059-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.139578 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.139580 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f211f38-f6d3-4bfe-b556-c3e418914059-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.139786 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.139597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tqsf\" (UniqueName: \"kubernetes.io/projected/6f211f38-f6d3-4bfe-b556-c3e418914059-kube-api-access-8tqsf\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.139786 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.139629 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f211f38-f6d3-4bfe-b556-c3e418914059-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.240411 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.240328 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f211f38-f6d3-4bfe-b556-c3e418914059-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.240411 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.240403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f211f38-f6d3-4bfe-b556-c3e418914059-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.240641 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.240443 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f211f38-f6d3-4bfe-b556-c3e418914059-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.240641 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.240460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tqsf\" (UniqueName: \"kubernetes.io/projected/6f211f38-f6d3-4bfe-b556-c3e418914059-kube-api-access-8tqsf\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.241147 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.241120 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f211f38-f6d3-4bfe-b556-c3e418914059-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.242802 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.242781 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f211f38-f6d3-4bfe-b556-c3e418914059-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.242898 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.242823 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f211f38-f6d3-4bfe-b556-c3e418914059-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.248918 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.248895 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tqsf\" (UniqueName: \"kubernetes.io/projected/6f211f38-f6d3-4bfe-b556-c3e418914059-kube-api-access-8tqsf\") pod \"prometheus-operator-6f4946db56-hw585\" (UID: \"6f211f38-f6d3-4bfe-b556-c3e418914059\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.312835 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.312805 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" Sep 07 12:39:31.593869 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.593789 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hw585"] Sep 07 12:39:31.596470 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:31.596439 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f211f38_f6d3_4bfe_b556_c3e418914059.slice/crio-fc9b10857e099ecd8e8210a17f29f047e40b7dd364b5d198493c50dc97a0de2d WatchSource:0}: Error finding container fc9b10857e099ecd8e8210a17f29f047e40b7dd364b5d198493c50dc97a0de2d: Status 404 returned error can't find the container with id fc9b10857e099ecd8e8210a17f29f047e40b7dd364b5d198493c50dc97a0de2d Sep 07 12:39:31.598429 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.598412 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:39:31.846235 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.846153 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:31.848340 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:31.848321 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a89c85a-e8a7-4711-8b42-c368f0521ca8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tsk2\" (UID: \"7a89c85a-e8a7-4711-8b42-c368f0521ca8\") " pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:32.038122 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:32.038082 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxwzv\"" Sep 07 12:39:32.046305 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:32.046278 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8tsk2" Sep 07 12:39:32.332196 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:32.332159 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8tsk2"] Sep 07 12:39:32.476116 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:32.476080 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" event={"ID":"6f211f38-f6d3-4bfe-b556-c3e418914059","Type":"ContainerStarted","Data":"fc9b10857e099ecd8e8210a17f29f047e40b7dd364b5d198493c50dc97a0de2d"} Sep 07 12:39:32.619713 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:32.619682 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a89c85a_e8a7_4711_8b42_c368f0521ca8.slice/crio-4b98fb96721b577ac9774498172aa7e560d07497f09124c6a2c7df1ca3e63448 WatchSource:0}: Error finding container 4b98fb96721b577ac9774498172aa7e560d07497f09124c6a2c7df1ca3e63448: Status 404 returned error can't find the container with id 4b98fb96721b577ac9774498172aa7e560d07497f09124c6a2c7df1ca3e63448 Sep 07 12:39:32.702844 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:32.702817 2558 patch_prober.go:28] interesting pod/image-registry-bf4547d5b-d4n62 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 07 12:39:32.702955 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:32.702867 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 12:39:33.481002 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:33.480964 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" event={"ID":"6f211f38-f6d3-4bfe-b556-c3e418914059","Type":"ContainerStarted","Data":"9a45fb5804fd62d02835505ce54d5dd764e90849de4fbc270da3b272e4890c03"} Sep 07 12:39:33.481428 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:33.481062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" event={"ID":"6f211f38-f6d3-4bfe-b556-c3e418914059","Type":"ContainerStarted","Data":"184afb1d4cacc9703760053375381b50d76dcfd19e21e5f284c718af300fb340"} Sep 07 12:39:33.482827 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:33.482802 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tsk2" event={"ID":"7a89c85a-e8a7-4711-8b42-c368f0521ca8","Type":"ContainerStarted","Data":"1e0a440dcebfe12f2c4c332874e975008dcba093ab7509d91901a346ddbd7b0f"} Sep 07 12:39:33.482945 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:33.482849 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tsk2" event={"ID":"7a89c85a-e8a7-4711-8b42-c368f0521ca8","Type":"ContainerStarted","Data":"99af9d2e457ed8dd6a026eb323f0efa1fa49a91fc914602392c8c42246317910"} Sep 07 12:39:33.482945 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:33.482871 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tsk2" event={"ID":"7a89c85a-e8a7-4711-8b42-c368f0521ca8","Type":"ContainerStarted","Data":"4b98fb96721b577ac9774498172aa7e560d07497f09124c6a2c7df1ca3e63448"} Sep 07 12:39:33.498128 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:33.498064 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-hw585" podStartSLOduration=2.448229986 podStartE2EDuration="3.498050073s" totalImagesPullingTime="1.049820087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:33.497606341 +0000 UTC m=+305.423046645" watchObservedRunningTime="2026-09-07 12:39:33.498050073 +0000 UTC m=+305.423490359" Sep 07 12:39:34.413638 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:34.413609 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:39:35.437918 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.437880 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj"] Sep 07 12:39:35.440357 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.440325 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.441714 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.441689 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wj2zb"] Sep 07 12:39:35.443439 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.443413 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 07 12:39:35.443560 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.443424 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 07 12:39:35.443659 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.443642 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-chqdp\"" Sep 07 12:39:35.444318 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.444303 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 07 12:39:35.444381 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.444327 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.447895 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.447870 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 12:39:35.448429 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.448411 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 12:39:35.448519 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.448504 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 12:39:35.448716 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.448694 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dnzl5\"" Sep 07 12:39:35.456983 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.456950 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj"] Sep 07 12:39:35.492040 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.492004 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tsk2" event={"ID":"7a89c85a-e8a7-4711-8b42-c368f0521ca8","Type":"ContainerStarted","Data":"718eb15f82a4f507d04ef8aff0798286e02c14e8bf5008e3231a8d0c17bd5700"} Sep 07 12:39:35.546198 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.546147 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8tsk2" podStartSLOduration=34.623787152 podStartE2EDuration="36.546131444s" totalImagesPullingTime="1.922344292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:38:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:35.545547999 +0000 UTC m=+307.470988316" watchObservedRunningTime="2026-09-07 12:39:35.546131444 +0000 UTC m=+307.471571748" Sep 07 12:39:35.583932 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.583900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:39:35.584081 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.583971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-sys\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584081 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.583900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:39:35.584175 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-textfile\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584175 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-wtmp\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584175 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24gf2\" (UniqueName: \"kubernetes.io/projected/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-api-access-24gf2\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.584286 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584286 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584244 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6jbb\" (UniqueName: \"kubernetes.io/projected/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-kube-api-access-d6jbb\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584286 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.584514 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.584514 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-tls\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584514 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584514 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584424 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.584689 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-metrics-client-ca\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584689 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.584689 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-root\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.584861 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.584684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.685345 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685311 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-sys\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685528 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-textfile\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685528 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-wtmp\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685528 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685434 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24gf2\" (UniqueName: \"kubernetes.io/projected/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-api-access-24gf2\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.685528 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685446 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-sys\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685528 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685481 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685528 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6jbb\" (UniqueName: \"kubernetes.io/projected/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-kube-api-access-d6jbb\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685547 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685609 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-tls\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685705 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-textfile\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-metrics-client-ca\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685607 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-wtmp\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.685856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-root\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.686306 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685916 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-root\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.686306 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.686306 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.685961 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.686306 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.686289 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-metrics-client-ca\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.686475 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.686289 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.686599 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.686578 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.687156 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.687133 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.688258 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.688197 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-tls\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.688368 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.688339 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.688448 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.688426 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.688531 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.688514 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.694364 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.694337 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24gf2\" (UniqueName: \"kubernetes.io/projected/6d71f95e-c3e2-4e5b-822c-ee24385bf82b-kube-api-access-24gf2\") pod \"kube-state-metrics-74cb57df7-ksfzj\" (UID: \"6d71f95e-c3e2-4e5b-822c-ee24385bf82b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.694700 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.694675 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6jbb\" (UniqueName: \"kubernetes.io/projected/e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5-kube-api-access-d6jbb\") pod \"node-exporter-wj2zb\" (UID: \"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5\") " pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.751145 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.751116 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" Sep 07 12:39:35.756747 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:35.756722 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wj2zb" Sep 07 12:39:35.769449 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:35.769420 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1248bb0_eaf9_479b_a0eb_2f6aa1dd09f5.slice/crio-b6c17ffa7cf3377d742713ffad590117b4791024a09d1bf9861a50948d41f09d WatchSource:0}: Error finding container b6c17ffa7cf3377d742713ffad590117b4791024a09d1bf9861a50948d41f09d: Status 404 returned error can't find the container with id b6c17ffa7cf3377d742713ffad590117b4791024a09d1bf9861a50948d41f09d Sep 07 12:39:36.030039 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.029864 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj"] Sep 07 12:39:36.032448 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:36.032420 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d71f95e_c3e2_4e5b_822c_ee24385bf82b.slice/crio-d787bb2e8ffa0e42638731d9025013895a86f251a4a8b160c5ba09ce1a8cab1f WatchSource:0}: Error finding container d787bb2e8ffa0e42638731d9025013895a86f251a4a8b160c5ba09ce1a8cab1f: Status 404 returned error can't find the container with id d787bb2e8ffa0e42638731d9025013895a86f251a4a8b160c5ba09ce1a8cab1f Sep 07 12:39:36.504568 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.504507 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" event={"ID":"6d71f95e-c3e2-4e5b-822c-ee24385bf82b","Type":"ContainerStarted","Data":"d787bb2e8ffa0e42638731d9025013895a86f251a4a8b160c5ba09ce1a8cab1f"} Sep 07 12:39:36.506658 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.506628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj2zb" event={"ID":"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5","Type":"ContainerStarted","Data":"b6c17ffa7cf3377d742713ffad590117b4791024a09d1bf9861a50948d41f09d"} Sep 07 12:39:36.556727 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.556682 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:39:36.560328 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.560303 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.563092 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.563062 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 12:39:36.564351 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.563433 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 12:39:36.564351 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.563874 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 12:39:36.564351 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.564180 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 12:39:36.564709 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.564450 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 12:39:36.564709 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.564457 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 12:39:36.564903 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.564832 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 12:39:36.564903 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.564849 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 12:39:36.565454 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.565304 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5hvc8\"" Sep 07 12:39:36.567358 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.565973 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 12:39:36.578237 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.578217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:39:36.696070 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696239 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-config-out\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696239 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696239 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696159 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696402 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696402 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696259 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696402 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696402 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696362 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696402 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696396 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-config-volume\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696673 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696673 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696673 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngjn\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-kube-api-access-lngjn\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.696673 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.696559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-web-config\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.797855 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.797810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.797994 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.797858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.797994 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.797926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.797994 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.797949 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.797994 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.797982 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-config-volume\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798079 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngjn\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-kube-api-access-lngjn\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798167 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-web-config\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798265 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798241 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-config-out\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798730 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798692 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.798789 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.798774 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.799147 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:36.799123 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 07 12:39:36.799248 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:39:36.799198 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls podName:d027afb0-e36f-4b7c-96cd-9398217badd0 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:37.299181504 +0000 UTC m=+309.224621789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0") : secret "alertmanager-main-tls" not found Sep 07 12:39:36.799919 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.799891 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.801681 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.801636 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.802209 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.802152 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-config-out\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.802402 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.802357 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.802910 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.802858 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-web-config\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.804172 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.804138 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.804420 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.804377 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.805197 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.805171 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.806296 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.806254 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-config-volume\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:36.813417 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:36.813393 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngjn\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-kube-api-access-lngjn\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:37.303219 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.303192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:37.305581 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.305558 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:37.475719 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.475636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:39:37.513504 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.512782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" event={"ID":"6d71f95e-c3e2-4e5b-822c-ee24385bf82b","Type":"ContainerStarted","Data":"e12d546dec224448b24ff94307ad7323ca1bb9c8c87a2c478ef394a57b03dde7"} Sep 07 12:39:37.513504 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.512862 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" event={"ID":"6d71f95e-c3e2-4e5b-822c-ee24385bf82b","Type":"ContainerStarted","Data":"46e39a0b0488133820a57357f583a294ca1f8286659795ce56656693d8b9634d"} Sep 07 12:39:37.513504 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.512894 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" event={"ID":"6d71f95e-c3e2-4e5b-822c-ee24385bf82b","Type":"ContainerStarted","Data":"d6b1aa2eeff5aee77508bdc25d350792a17e537b2ba174c28eee8dd5878913b2"} Sep 07 12:39:37.515753 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.515723 2558 generic.go:356] "Generic (PLEG): container finished" podID="e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5" containerID="94ab29164f041ff5b5ea625071bf0f34ae8f9426851cf68531337a5dcc69c337" exitCode=0 Sep 07 12:39:37.515904 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.515815 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj2zb" event={"ID":"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5","Type":"ContainerDied","Data":"94ab29164f041ff5b5ea625071bf0f34ae8f9426851cf68531337a5dcc69c337"} Sep 07 12:39:37.540344 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.537738 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-ksfzj" podStartSLOduration=1.3853035839999999 podStartE2EDuration="2.537713626s" totalImagesPullingTime="1.152410042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:37.536030435 +0000 UTC m=+309.461470739" watchObservedRunningTime="2026-09-07 12:39:37.537713626 +0000 UTC m=+309.463153933" Sep 07 12:39:37.784650 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:37.784572 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:39:37.787706 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:39:37.787678 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd027afb0_e36f_4b7c_96cd_9398217badd0.slice/crio-4d48babfabe038b7d485009eb9ff2f23f75c0bbc600a8c540408e7c2cd368cca WatchSource:0}: Error finding container 4d48babfabe038b7d485009eb9ff2f23f75c0bbc600a8c540408e7c2cd368cca: Status 404 returned error can't find the container with id 4d48babfabe038b7d485009eb9ff2f23f75c0bbc600a8c540408e7c2cd368cca Sep 07 12:39:38.522176 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:38.522144 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj2zb" event={"ID":"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5","Type":"ContainerStarted","Data":"9ac2db7699a6e10873797858a6dad799bc3ce28a1438fa528cb729fb55992249"} Sep 07 12:39:38.522612 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:38.522201 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj2zb" event={"ID":"e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5","Type":"ContainerStarted","Data":"139a28cc6ce7574e84f5ea5c6efc35af51711fee32edd7c3e08d2d27c0ab0656"} Sep 07 12:39:38.523452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:38.523429 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerStarted","Data":"4d48babfabe038b7d485009eb9ff2f23f75c0bbc600a8c540408e7c2cd368cca"} Sep 07 12:39:38.546084 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:38.546037 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wj2zb" podStartSLOduration=2.517834786 podStartE2EDuration="3.546019662s" totalImagesPullingTime="957.48989ms" totalInitContainerRuntime="70.694986ms" isStatefulPod=true podCreationTimestamp="2026-09-07 12:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:38.544723815 +0000 UTC m=+310.470164138" watchObservedRunningTime="2026-09-07 12:39:38.546019662 +0000 UTC m=+310.471459965" Sep 07 12:39:39.528788 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:39.528742 2558 generic.go:356] "Generic (PLEG): container finished" podID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerID="1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5" exitCode=0 Sep 07 12:39:39.529136 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:39.528825 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerDied","Data":"1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5"} Sep 07 12:39:41.542706 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:41.542662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerStarted","Data":"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3"} Sep 07 12:39:41.543114 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:41.542754 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerStarted","Data":"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0"} Sep 07 12:39:41.543114 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:41.542793 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerStarted","Data":"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f"} Sep 07 12:39:41.543114 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:41.542834 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerStarted","Data":"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103"} Sep 07 12:39:41.543114 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:41.542875 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerStarted","Data":"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63"} Sep 07 12:39:42.550970 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:42.550932 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerStarted","Data":"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9"} Sep 07 12:39:42.578524 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:42.578449 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.300923542 podStartE2EDuration="6.57843124s" totalImagesPullingTime="3.260432029s" totalInitContainerRuntime="17.075669ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:39:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:42.576430133 +0000 UTC m=+314.501870497" watchObservedRunningTime="2026-09-07 12:39:42.57843124 +0000 UTC m=+314.503871543" Sep 07 12:39:49.269507 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:39:49.269455 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bf4547d5b-d4n62"] Sep 07 12:40:04.629016 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:04.628980 2558 generic.go:356] "Generic (PLEG): container finished" podID="b2743122-2067-4c75-91e6-6187927e3b59" containerID="5ba8d76f33cb19998aa2cd9f56321de402d2347dcbb764643bcbc5da7ba846b7" exitCode=0 Sep 07 12:40:04.629399 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:04.629051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" event={"ID":"b2743122-2067-4c75-91e6-6187927e3b59","Type":"ContainerDied","Data":"5ba8d76f33cb19998aa2cd9f56321de402d2347dcbb764643bcbc5da7ba846b7"} Sep 07 12:40:04.629399 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:04.629371 2558 scope.go:117] "RemoveContainer" containerID="5ba8d76f33cb19998aa2cd9f56321de402d2347dcbb764643bcbc5da7ba846b7" Sep 07 12:40:05.634221 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:05.634185 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-nrslh" event={"ID":"b2743122-2067-4c75-91e6-6187927e3b59","Type":"ContainerStarted","Data":"3c148759013073181168d606809e79ec710273835bb02f357327a70a88dd4742"} Sep 07 12:40:14.289616 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.289568 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" containerName="registry" containerID="cri-o://f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428" gracePeriod=30 Sep 07 12:40:14.408604 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.408576 2558 patch_prober.go:28] interesting pod/image-registry-bf4547d5b-d4n62 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Sep 07 12:40:14.408708 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.408623 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Sep 07 12:40:14.523418 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.523394 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:40:14.637842 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.637814 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36f5b992-4259-4a13-a46f-d0b96838abeb-ca-trust-extracted\") pod \"36f5b992-4259-4a13-a46f-d0b96838abeb\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " Sep 07 12:40:14.638001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.637859 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-trusted-ca\") pod \"36f5b992-4259-4a13-a46f-d0b96838abeb\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " Sep 07 12:40:14.638001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.637905 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-installation-pull-secrets\") pod \"36f5b992-4259-4a13-a46f-d0b96838abeb\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " Sep 07 12:40:14.638001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.637986 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgjs2\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-kube-api-access-qgjs2\") pod \"36f5b992-4259-4a13-a46f-d0b96838abeb\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " Sep 07 12:40:14.638133 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.638012 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-bound-sa-token\") pod \"36f5b992-4259-4a13-a46f-d0b96838abeb\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " Sep 07 12:40:14.638133 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.638043 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") pod \"36f5b992-4259-4a13-a46f-d0b96838abeb\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " Sep 07 12:40:14.638133 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.638072 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-image-registry-private-configuration\") pod \"36f5b992-4259-4a13-a46f-d0b96838abeb\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " Sep 07 12:40:14.638133 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.638124 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-certificates\") pod \"36f5b992-4259-4a13-a46f-d0b96838abeb\" (UID: \"36f5b992-4259-4a13-a46f-d0b96838abeb\") " Sep 07 12:40:14.638475 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.638417 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "36f5b992-4259-4a13-a46f-d0b96838abeb" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:40:14.638807 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.638769 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "36f5b992-4259-4a13-a46f-d0b96838abeb" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:40:14.640659 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.640626 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-kube-api-access-qgjs2" (OuterVolumeSpecName: "kube-api-access-qgjs2") pod "36f5b992-4259-4a13-a46f-d0b96838abeb" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb"). InnerVolumeSpecName "kube-api-access-qgjs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:40:14.640769 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.640632 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "36f5b992-4259-4a13-a46f-d0b96838abeb" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:14.640769 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.640727 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "36f5b992-4259-4a13-a46f-d0b96838abeb" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:40:14.640847 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.640797 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "36f5b992-4259-4a13-a46f-d0b96838abeb" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:40:14.641128 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.641111 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "36f5b992-4259-4a13-a46f-d0b96838abeb" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:14.646597 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.646570 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36f5b992-4259-4a13-a46f-d0b96838abeb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "36f5b992-4259-4a13-a46f-d0b96838abeb" (UID: "36f5b992-4259-4a13-a46f-d0b96838abeb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:40:14.668197 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.668171 2558 generic.go:356] "Generic (PLEG): container finished" podID="36f5b992-4259-4a13-a46f-d0b96838abeb" containerID="f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428" exitCode=0 Sep 07 12:40:14.668307 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.668219 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" Sep 07 12:40:14.668307 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.668263 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" event={"ID":"36f5b992-4259-4a13-a46f-d0b96838abeb","Type":"ContainerDied","Data":"f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428"} Sep 07 12:40:14.668375 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.668315 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bf4547d5b-d4n62" event={"ID":"36f5b992-4259-4a13-a46f-d0b96838abeb","Type":"ContainerDied","Data":"a406627b3b6d0085595546a5404f9507a0026b162c459786f7f9717a5a88cea5"} Sep 07 12:40:14.668375 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.668346 2558 scope.go:117] "RemoveContainer" containerID="f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428" Sep 07 12:40:14.677413 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.677396 2558 scope.go:117] "RemoveContainer" containerID="f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428" Sep 07 12:40:14.677701 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:40:14.677680 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428\": container with ID starting with f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428 not found: ID does not exist" containerID="f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428" Sep 07 12:40:14.677757 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.677711 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428"} err="failed to get container status \"f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428\": rpc error: code = NotFound desc = could not find container \"f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428\": container with ID starting with f428a25cc1ad0e2a4321651c6d89ad5ae1921d26bc6e98048b368c00be4a0428 not found: ID does not exist" Sep 07 12:40:14.689791 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.689764 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bf4547d5b-d4n62"] Sep 07 12:40:14.696548 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.696525 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bf4547d5b-d4n62"] Sep 07 12:40:14.739077 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.739050 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-certificates\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:14.739077 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.739074 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36f5b992-4259-4a13-a46f-d0b96838abeb-ca-trust-extracted\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:14.739077 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.739083 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36f5b992-4259-4a13-a46f-d0b96838abeb-trusted-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:14.739273 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.739092 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-installation-pull-secrets\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:14.739273 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.739102 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgjs2\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-kube-api-access-qgjs2\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:14.739273 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.739110 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-bound-sa-token\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:14.739273 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.739118 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36f5b992-4259-4a13-a46f-d0b96838abeb-registry-tls\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:14.739273 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:14.739125 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36f5b992-4259-4a13-a46f-d0b96838abeb-image-registry-private-configuration\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:16.594110 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:16.594077 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" path="/var/lib/kubelet/pods/36f5b992-4259-4a13-a46f-d0b96838abeb/volumes" Sep 07 12:40:19.689925 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:19.689844 2558 generic.go:356] "Generic (PLEG): container finished" podID="825b7c6f-bea9-4f0c-96cd-feedb27fb12b" containerID="b54aa06114a62529233ed4935dc632ee570d7e645a2fe62fc621c8c842d74066" exitCode=0 Sep 07 12:40:19.690267 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:19.689921 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" event={"ID":"825b7c6f-bea9-4f0c-96cd-feedb27fb12b","Type":"ContainerDied","Data":"b54aa06114a62529233ed4935dc632ee570d7e645a2fe62fc621c8c842d74066"} Sep 07 12:40:19.690307 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:19.690271 2558 scope.go:117] "RemoveContainer" containerID="b54aa06114a62529233ed4935dc632ee570d7e645a2fe62fc621c8c842d74066" Sep 07 12:40:20.695757 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:20.695683 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dfrxl" event={"ID":"825b7c6f-bea9-4f0c-96cd-feedb27fb12b","Type":"ContainerStarted","Data":"6159643a3c276794d6bc11867ad197dd82522e3f49da1bae2af03854078af4c9"} Sep 07 12:40:41.469224 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:41.469187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:40:41.471520 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:41.471462 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e722016-4e1c-4cd0-80cb-19d044cc821e-metrics-certs\") pod \"network-metrics-daemon-p8mnv\" (UID: \"5e722016-4e1c-4cd0-80cb-19d044cc821e\") " pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:40:41.587452 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:41.587418 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsbg4\"" Sep 07 12:40:41.595572 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:41.595548 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8mnv" Sep 07 12:40:41.886708 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:41.886671 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8mnv"] Sep 07 12:40:41.893611 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:40:41.893583 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e722016_4e1c_4cd0_80cb_19d044cc821e.slice/crio-9df74ec4488085ac1e8a8274f094179bfcf61dfaf83728ba2b109b59637753ac WatchSource:0}: Error finding container 9df74ec4488085ac1e8a8274f094179bfcf61dfaf83728ba2b109b59637753ac: Status 404 returned error can't find the container with id 9df74ec4488085ac1e8a8274f094179bfcf61dfaf83728ba2b109b59637753ac Sep 07 12:40:42.779471 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:42.779426 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8mnv" event={"ID":"5e722016-4e1c-4cd0-80cb-19d044cc821e","Type":"ContainerStarted","Data":"9df74ec4488085ac1e8a8274f094179bfcf61dfaf83728ba2b109b59637753ac"} Sep 07 12:40:43.784409 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:43.784372 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8mnv" event={"ID":"5e722016-4e1c-4cd0-80cb-19d044cc821e","Type":"ContainerStarted","Data":"36daa708bb74f7e71d970a7deccb6056b3ce5bb0e54faf397420c8dfdedd1e6f"} Sep 07 12:40:43.784787 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:43.784428 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8mnv" event={"ID":"5e722016-4e1c-4cd0-80cb-19d044cc821e","Type":"ContainerStarted","Data":"d4c4ad0a538775512b5aa63954fdcf8c1417a461c1bfbbd97d3bafd5348049ad"} Sep 07 12:40:43.805712 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:43.805666 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p8mnv" podStartSLOduration=374.488236292 podStartE2EDuration="6m15.805649458s" totalImagesPullingTime="1.317413166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:40:43.803400126 +0000 UTC m=+375.728840430" watchObservedRunningTime="2026-09-07 12:40:43.805649458 +0000 UTC m=+375.731089784" Sep 07 12:40:56.097547 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.097506 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:40:56.098042 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.097943 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy-metric" containerID="cri-o://57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3" gracePeriod=120 Sep 07 12:40:56.098153 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.098118 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="prom-label-proxy" containerID="cri-o://22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9" gracePeriod=120 Sep 07 12:40:56.098252 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.098234 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy" containerID="cri-o://c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0" gracePeriod=120 Sep 07 12:40:56.098312 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.098222 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy-web" containerID="cri-o://968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f" gracePeriod=120 Sep 07 12:40:56.098312 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.098272 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="config-reloader" containerID="cri-o://755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103" gracePeriod=120 Sep 07 12:40:56.098411 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.098329 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="alertmanager" containerID="cri-o://e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63" gracePeriod=120 Sep 07 12:40:56.834478 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.834440 2558 generic.go:356] "Generic (PLEG): container finished" podID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerID="22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9" exitCode=0 Sep 07 12:40:56.834478 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.834469 2558 generic.go:356] "Generic (PLEG): container finished" podID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerID="c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0" exitCode=0 Sep 07 12:40:56.834478 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.834476 2558 generic.go:356] "Generic (PLEG): container finished" podID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerID="755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103" exitCode=0 Sep 07 12:40:56.834478 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.834494 2558 generic.go:356] "Generic (PLEG): container finished" podID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerID="e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63" exitCode=0 Sep 07 12:40:56.834818 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.834526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerDied","Data":"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9"} Sep 07 12:40:56.834818 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.834612 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerDied","Data":"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0"} Sep 07 12:40:56.834818 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.834653 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerDied","Data":"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103"} Sep 07 12:40:56.834818 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:56.834693 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerDied","Data":"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63"} Sep 07 12:40:57.346573 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.346550 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:57.397981 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.397952 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398147 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.397998 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-metrics-client-ca\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398147 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398026 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-main-db\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398147 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398062 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lngjn\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-kube-api-access-lngjn\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398147 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398089 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-config-out\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398147 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398112 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-web\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398147 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398139 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-web-config\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398181 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398213 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-tls-assets\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398245 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-trusted-ca-bundle\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398283 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398327 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-config-volume\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398447 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398358 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-cluster-tls-config\") pod \"d027afb0-e36f-4b7c-96cd-9398217badd0\" (UID: \"d027afb0-e36f-4b7c-96cd-9398217badd0\") " Sep 07 12:40:57.398752 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398723 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:40:57.398752 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398735 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:40:57.398964 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.398747 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:40:57.403224 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.403170 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:57.403710 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.403672 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:57.403966 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.403932 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:40:57.404522 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.404390 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:57.404522 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.404473 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-kube-api-access-lngjn" (OuterVolumeSpecName: "kube-api-access-lngjn") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "kube-api-access-lngjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:40:57.404874 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.404847 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-config-out" (OuterVolumeSpecName: "config-out") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:40:57.405146 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.405119 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-config-volume" (OuterVolumeSpecName: "config-volume") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:57.406355 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.406329 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:57.407674 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.407627 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:57.413951 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.413929 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-web-config" (OuterVolumeSpecName: "web-config") pod "d027afb0-e36f-4b7c-96cd-9398217badd0" (UID: "d027afb0-e36f-4b7c-96cd-9398217badd0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:40:57.499860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499781 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.499860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499808 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-config-volume\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.499860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499818 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-cluster-tls-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.499860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499827 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-main-tls\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.499860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499838 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-metrics-client-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.499860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499846 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-main-db\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.499860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499854 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lngjn\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-kube-api-access-lngjn\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.499860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499862 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d027afb0-e36f-4b7c-96cd-9398217badd0-config-out\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.500189 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499872 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.500189 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499881 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-web-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.500189 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499891 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d027afb0-e36f-4b7c-96cd-9398217badd0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.500189 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499899 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d027afb0-e36f-4b7c-96cd-9398217badd0-tls-assets\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.500189 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.499906 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d027afb0-e36f-4b7c-96cd-9398217badd0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Sep 07 12:40:57.841446 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.841361 2558 generic.go:356] "Generic (PLEG): container finished" podID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerID="57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3" exitCode=0 Sep 07 12:40:57.841446 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.841389 2558 generic.go:356] "Generic (PLEG): container finished" podID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerID="968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f" exitCode=0 Sep 07 12:40:57.841446 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.841430 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:57.841661 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.841444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerDied","Data":"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3"} Sep 07 12:40:57.841661 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.841526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerDied","Data":"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f"} Sep 07 12:40:57.841661 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.841555 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d027afb0-e36f-4b7c-96cd-9398217badd0","Type":"ContainerDied","Data":"4d48babfabe038b7d485009eb9ff2f23f75c0bbc600a8c540408e7c2cd368cca"} Sep 07 12:40:57.841661 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.841595 2558 scope.go:117] "RemoveContainer" containerID="22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9" Sep 07 12:40:57.849726 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.849707 2558 scope.go:117] "RemoveContainer" containerID="57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3" Sep 07 12:40:57.856812 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.856793 2558 scope.go:117] "RemoveContainer" containerID="c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0" Sep 07 12:40:57.863403 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.863385 2558 scope.go:117] "RemoveContainer" containerID="968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f" Sep 07 12:40:57.868279 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.868258 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:40:57.870369 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.870353 2558 scope.go:117] "RemoveContainer" containerID="755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103" Sep 07 12:40:57.877196 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.877179 2558 scope.go:117] "RemoveContainer" containerID="e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63" Sep 07 12:40:57.886325 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.886302 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:40:57.892199 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.892161 2558 scope.go:117] "RemoveContainer" containerID="1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5" Sep 07 12:40:57.899149 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.899130 2558 scope.go:117] "RemoveContainer" containerID="22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9" Sep 07 12:40:57.899424 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:40:57.899406 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9\": container with ID starting with 22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9 not found: ID does not exist" containerID="22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9" Sep 07 12:40:57.899508 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.899431 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9"} err="failed to get container status \"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9\": rpc error: code = NotFound desc = could not find container \"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9\": container with ID starting with 22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9 not found: ID does not exist" Sep 07 12:40:57.899508 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.899449 2558 scope.go:117] "RemoveContainer" containerID="57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3" Sep 07 12:40:57.899735 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:40:57.899720 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3\": container with ID starting with 57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3 not found: ID does not exist" containerID="57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3" Sep 07 12:40:57.899771 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.899739 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3"} err="failed to get container status \"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3\": rpc error: code = NotFound desc = could not find container \"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3\": container with ID starting with 57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3 not found: ID does not exist" Sep 07 12:40:57.899771 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.899753 2558 scope.go:117] "RemoveContainer" containerID="c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0" Sep 07 12:40:57.899988 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:40:57.899970 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0\": container with ID starting with c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0 not found: ID does not exist" containerID="c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0" Sep 07 12:40:57.900032 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.899991 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0"} err="failed to get container status \"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0\": rpc error: code = NotFound desc = could not find container \"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0\": container with ID starting with c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0 not found: ID does not exist" Sep 07 12:40:57.900032 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900005 2558 scope.go:117] "RemoveContainer" containerID="968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f" Sep 07 12:40:57.900207 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:40:57.900192 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f\": container with ID starting with 968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f not found: ID does not exist" containerID="968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f" Sep 07 12:40:57.900250 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900211 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f"} err="failed to get container status \"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f\": rpc error: code = NotFound desc = could not find container \"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f\": container with ID starting with 968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f not found: ID does not exist" Sep 07 12:40:57.900250 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900223 2558 scope.go:117] "RemoveContainer" containerID="755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103" Sep 07 12:40:57.900436 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:40:57.900420 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103\": container with ID starting with 755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103 not found: ID does not exist" containerID="755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103" Sep 07 12:40:57.900496 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900438 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103"} err="failed to get container status \"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103\": rpc error: code = NotFound desc = could not find container \"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103\": container with ID starting with 755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103 not found: ID does not exist" Sep 07 12:40:57.900496 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900451 2558 scope.go:117] "RemoveContainer" containerID="e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63" Sep 07 12:40:57.900695 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:40:57.900680 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63\": container with ID starting with e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63 not found: ID does not exist" containerID="e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63" Sep 07 12:40:57.900741 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900697 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63"} err="failed to get container status \"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63\": rpc error: code = NotFound desc = could not find container \"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63\": container with ID starting with e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63 not found: ID does not exist" Sep 07 12:40:57.900741 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900709 2558 scope.go:117] "RemoveContainer" containerID="1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5" Sep 07 12:40:57.900920 ip-10-0-128-213 kubenswrapper[2558]: E0907 12:40:57.900907 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5\": container with ID starting with 1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5 not found: ID does not exist" containerID="1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5" Sep 07 12:40:57.900964 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900922 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5"} err="failed to get container status \"1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5\": rpc error: code = NotFound desc = could not find container \"1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5\": container with ID starting with 1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5 not found: ID does not exist" Sep 07 12:40:57.900964 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.900932 2558 scope.go:117] "RemoveContainer" containerID="22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9" Sep 07 12:40:57.901153 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.901138 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9"} err="failed to get container status \"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9\": rpc error: code = NotFound desc = could not find container \"22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9\": container with ID starting with 22df7cf350b6caf3f4029ee6405659e48f5f7c9ef6e32687ac33a18b7f72d1c9 not found: ID does not exist" Sep 07 12:40:57.901195 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.901153 2558 scope.go:117] "RemoveContainer" containerID="57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3" Sep 07 12:40:57.901395 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.901374 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3"} err="failed to get container status \"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3\": rpc error: code = NotFound desc = could not find container \"57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3\": container with ID starting with 57212a239a138d4754d63c993c8b904a6df78b6917ecd971eba4753fa736b1c3 not found: ID does not exist" Sep 07 12:40:57.901438 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.901398 2558 scope.go:117] "RemoveContainer" containerID="c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0" Sep 07 12:40:57.901657 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.901638 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0"} err="failed to get container status \"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0\": rpc error: code = NotFound desc = could not find container \"c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0\": container with ID starting with c0b5d748b794ee380f215e790ba62d44170e94ee2e3c300468abcd750c0c3ad0 not found: ID does not exist" Sep 07 12:40:57.901657 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.901656 2558 scope.go:117] "RemoveContainer" containerID="968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f" Sep 07 12:40:57.901884 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.901863 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f"} err="failed to get container status \"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f\": rpc error: code = NotFound desc = could not find container \"968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f\": container with ID starting with 968a61f3a56f8cb5dce58e575eaf2ded231b486b87f98dd37bb51c0800d30e3f not found: ID does not exist" Sep 07 12:40:57.901922 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.901886 2558 scope.go:117] "RemoveContainer" containerID="755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103" Sep 07 12:40:57.902111 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.902090 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103"} err="failed to get container status \"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103\": rpc error: code = NotFound desc = could not find container \"755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103\": container with ID starting with 755909e11e0db4508d62d0dc3859442b3921c9f0140ec9ad9ca9929e46b50103 not found: ID does not exist" Sep 07 12:40:57.902164 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.902112 2558 scope.go:117] "RemoveContainer" containerID="e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63" Sep 07 12:40:57.902362 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.902341 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63"} err="failed to get container status \"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63\": rpc error: code = NotFound desc = could not find container \"e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63\": container with ID starting with e1b3eba4abe6703972c1d1184113338fbad57cc85688a582dac22347d7a1ad63 not found: ID does not exist" Sep 07 12:40:57.902404 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.902364 2558 scope.go:117] "RemoveContainer" containerID="1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5" Sep 07 12:40:57.902644 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.902628 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5"} err="failed to get container status \"1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5\": rpc error: code = NotFound desc = could not find container \"1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5\": container with ID starting with 1de6e6ee87546d2f65653b67a5a2e5e6a5c8861cca2a8dc8c17c10c0a06291a5 not found: ID does not exist" Sep 07 12:40:57.920813 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.920791 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:40:57.921077 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921065 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy-web" Sep 07 12:40:57.921127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921079 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy-web" Sep 07 12:40:57.921127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921090 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" containerName="registry" Sep 07 12:40:57.921127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921096 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" containerName="registry" Sep 07 12:40:57.921127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921104 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="config-reloader" Sep 07 12:40:57.921127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921109 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="config-reloader" Sep 07 12:40:57.921127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921118 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="init-config-reloader" Sep 07 12:40:57.921127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921124 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="init-config-reloader" Sep 07 12:40:57.921127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921130 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="alertmanager" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921135 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="alertmanager" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921145 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="prom-label-proxy" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921150 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="prom-label-proxy" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921160 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921165 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921172 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy-metric" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921178 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy-metric" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921218 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy-metric" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921225 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="alertmanager" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921232 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy-web" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921237 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="config-reloader" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921241 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="kube-rbac-proxy" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921247 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="36f5b992-4259-4a13-a46f-d0b96838abeb" containerName="registry" Sep 07 12:40:57.921346 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.921252 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" containerName="prom-label-proxy" Sep 07 12:40:57.927778 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.926122 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:57.928572 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.928551 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5hvc8\"" Sep 07 12:40:57.931704 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.931685 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 12:40:57.932106 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.932093 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 12:40:57.932189 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.932175 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 12:40:57.932379 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.932361 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 12:40:57.932503 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.932454 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 12:40:57.932647 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.932618 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 12:40:57.932647 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.932639 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 12:40:57.932981 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.932957 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 12:40:57.936857 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.936840 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 12:40:57.948170 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:57.948145 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:40:58.003512 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-web-config\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003512 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003715 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckz78\" (UniqueName: \"kubernetes.io/projected/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-kube-api-access-ckz78\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003715 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003715 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003647 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003715 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003676 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003854 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003854 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003854 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-config-out\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003854 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.003854 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.004012 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.004012 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.003919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104304 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-web-config\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104304 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104304 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104265 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckz78\" (UniqueName: \"kubernetes.io/projected/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-kube-api-access-ckz78\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104304 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104304 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104394 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-config-out\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104505 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.104713 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.104568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.107746 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107504 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.107746 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107536 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.107746 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107629 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.107746 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107635 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-config-out\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.107746 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107699 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-web-config\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.108001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107788 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.108001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107808 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.108001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107826 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.108001 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.107842 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.108128 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.108093 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.108425 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.108406 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.109520 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.109500 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.114721 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.114699 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckz78\" (UniqueName: \"kubernetes.io/projected/2485d6bf-a1f4-4c53-b2af-bcfab992abcb-kube-api-access-ckz78\") pod \"alertmanager-main-0\" (UID: \"2485d6bf-a1f4-4c53-b2af-bcfab992abcb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.237375 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.237336 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:40:58.521187 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.521154 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:40:58.524191 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:40:58.524164 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2485d6bf_a1f4_4c53_b2af_bcfab992abcb.slice/crio-c5841fc893d6904bd376119ce26a0aa8a65bfdb0c93befc1529084e2de10034d WatchSource:0}: Error finding container c5841fc893d6904bd376119ce26a0aa8a65bfdb0c93befc1529084e2de10034d: Status 404 returned error can't find the container with id c5841fc893d6904bd376119ce26a0aa8a65bfdb0c93befc1529084e2de10034d Sep 07 12:40:58.588839 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.588812 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d027afb0-e36f-4b7c-96cd-9398217badd0" path="/var/lib/kubelet/pods/d027afb0-e36f-4b7c-96cd-9398217badd0/volumes" Sep 07 12:40:58.847654 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.847563 2558 generic.go:356] "Generic (PLEG): container finished" podID="2485d6bf-a1f4-4c53-b2af-bcfab992abcb" containerID="492b7ba518f696e0d9a469f380af8f3102994571d39d1a011c9339ed7caa2306" exitCode=0 Sep 07 12:40:58.847654 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.847621 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2485d6bf-a1f4-4c53-b2af-bcfab992abcb","Type":"ContainerDied","Data":"492b7ba518f696e0d9a469f380af8f3102994571d39d1a011c9339ed7caa2306"} Sep 07 12:40:58.847885 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:58.847693 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2485d6bf-a1f4-4c53-b2af-bcfab992abcb","Type":"ContainerStarted","Data":"c5841fc893d6904bd376119ce26a0aa8a65bfdb0c93befc1529084e2de10034d"} Sep 07 12:40:59.855755 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:59.855721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2485d6bf-a1f4-4c53-b2af-bcfab992abcb","Type":"ContainerStarted","Data":"c27ce57655ccc376f58e45474890251a0e7bef27c26e2848fd7ec2deb704f738"} Sep 07 12:40:59.856107 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:59.855788 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2485d6bf-a1f4-4c53-b2af-bcfab992abcb","Type":"ContainerStarted","Data":"824023b8267966b92e8a1e921c8fd01951007e7d63dee1827561cf3500a3bdb0"} Sep 07 12:40:59.856107 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:59.855813 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2485d6bf-a1f4-4c53-b2af-bcfab992abcb","Type":"ContainerStarted","Data":"8468722a361de103176887fbfdd110e02fd4cd8cc9cc1d823cd78ccae669b043"} Sep 07 12:40:59.856107 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:59.855838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2485d6bf-a1f4-4c53-b2af-bcfab992abcb","Type":"ContainerStarted","Data":"18053400bfb34ad2330d1ba80e0d6e218b1904b7554d858e2b1460168867beb9"} Sep 07 12:40:59.856107 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:59.855865 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2485d6bf-a1f4-4c53-b2af-bcfab992abcb","Type":"ContainerStarted","Data":"b7a285abe19abe6d0fbc377759ab46f5c1566e404c849a5ccda7a18cb2fc7594"} Sep 07 12:40:59.856107 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:59.855891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2485d6bf-a1f4-4c53-b2af-bcfab992abcb","Type":"ContainerStarted","Data":"e172d572485ebfd11556ba088aa536bc487ce75e2152b151caa3d8994fe09be7"} Sep 07 12:40:59.896058 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:40:59.896004 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.883274102 podStartE2EDuration="2.89598484s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.710738ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:40:59.893606421 +0000 UTC m=+391.819046744" watchObservedRunningTime="2026-09-07 12:40:59.89598484 +0000 UTC m=+391.821425141" Sep 07 12:41:14.441817 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:41:14.441768 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:41:14.444326 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:41:14.444299 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f290dd5-53c4-4b6b-bdaa-668ba1ab7862-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-k8mph\" (UID: \"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862\") " pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:41:14.587232 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:41:14.587201 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h88x9\"" Sep 07 12:41:14.595201 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:41:14.595179 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" Sep 07 12:41:14.870020 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:41:14.869991 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-k8mph"] Sep 07 12:41:14.873710 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:41:14.873681 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f290dd5_53c4_4b6b_bdaa_668ba1ab7862.slice/crio-1f188b90e4cae6274bc3d1f18596add0a3ac8a64fc4843db820aa38cb0017553 WatchSource:0}: Error finding container 1f188b90e4cae6274bc3d1f18596add0a3ac8a64fc4843db820aa38cb0017553: Status 404 returned error can't find the container with id 1f188b90e4cae6274bc3d1f18596add0a3ac8a64fc4843db820aa38cb0017553 Sep 07 12:41:14.912869 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:41:14.912840 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" event={"ID":"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862","Type":"ContainerStarted","Data":"1f188b90e4cae6274bc3d1f18596add0a3ac8a64fc4843db820aa38cb0017553"} Sep 07 12:41:16.922940 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:41:16.922902 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" event={"ID":"5f290dd5-53c4-4b6b-bdaa-668ba1ab7862","Type":"ContainerStarted","Data":"207070ca4734050d9577e0cf5642dad6a0e9c446b2f4d30ecf9c3d9cdb97a9f3"} Sep 07 12:41:16.941759 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:41:16.941713 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-k8mph" podStartSLOduration=389.914175091 podStartE2EDuration="6m30.941695569s" totalImagesPullingTime="1.027520478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:16.93977559 +0000 UTC m=+408.865215894" watchObservedRunningTime="2026-09-07 12:41:16.941695569 +0000 UTC m=+408.867135872" Sep 07 12:42:54.993846 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:54.993811 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qqcfj"] Sep 07 12:42:54.996862 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:54.996841 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:54.999629 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:54.999606 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 07 12:42:54.999768 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:54.999633 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 07 12:42:55.000157 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.000142 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4tftk\"" Sep 07 12:42:55.013958 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.013934 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qqcfj"] Sep 07 12:42:55.126852 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.126814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dw9w\" (UniqueName: \"kubernetes.io/projected/cc9b3da7-9aca-44dd-b0fb-a7316686636a-kube-api-access-8dw9w\") pod \"cert-manager-webhook-6486ffd997-qqcfj\" (UID: \"cc9b3da7-9aca-44dd-b0fb-a7316686636a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:55.126852 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.126855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc9b3da7-9aca-44dd-b0fb-a7316686636a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qqcfj\" (UID: \"cc9b3da7-9aca-44dd-b0fb-a7316686636a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:55.228133 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.228082 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dw9w\" (UniqueName: \"kubernetes.io/projected/cc9b3da7-9aca-44dd-b0fb-a7316686636a-kube-api-access-8dw9w\") pod \"cert-manager-webhook-6486ffd997-qqcfj\" (UID: \"cc9b3da7-9aca-44dd-b0fb-a7316686636a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:55.228133 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.228135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc9b3da7-9aca-44dd-b0fb-a7316686636a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qqcfj\" (UID: \"cc9b3da7-9aca-44dd-b0fb-a7316686636a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:55.238743 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.238715 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc9b3da7-9aca-44dd-b0fb-a7316686636a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qqcfj\" (UID: \"cc9b3da7-9aca-44dd-b0fb-a7316686636a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:55.238860 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.238832 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dw9w\" (UniqueName: \"kubernetes.io/projected/cc9b3da7-9aca-44dd-b0fb-a7316686636a-kube-api-access-8dw9w\") pod \"cert-manager-webhook-6486ffd997-qqcfj\" (UID: \"cc9b3da7-9aca-44dd-b0fb-a7316686636a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:55.306080 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.306006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:55.581819 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:55.581796 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qqcfj"] Sep 07 12:42:55.584573 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:42:55.584547 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc9b3da7_9aca_44dd_b0fb_a7316686636a.slice/crio-778627845a4c044f76013b210aff7f2946189fe03a9db977d7e9f99152a53445 WatchSource:0}: Error finding container 778627845a4c044f76013b210aff7f2946189fe03a9db977d7e9f99152a53445: Status 404 returned error can't find the container with id 778627845a4c044f76013b210aff7f2946189fe03a9db977d7e9f99152a53445 Sep 07 12:42:56.285625 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:56.285584 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" event={"ID":"cc9b3da7-9aca-44dd-b0fb-a7316686636a","Type":"ContainerStarted","Data":"778627845a4c044f76013b210aff7f2946189fe03a9db977d7e9f99152a53445"} Sep 07 12:42:59.301450 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:59.301411 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" event={"ID":"cc9b3da7-9aca-44dd-b0fb-a7316686636a","Type":"ContainerStarted","Data":"a395a0c84c0f5524bcbeb3e5e76b5c1a6d3de6b0c2bb754f9ff4ac0e7057cfce"} Sep 07 12:42:59.302009 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:59.301559 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:42:59.318892 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:42:59.318844 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" podStartSLOduration=2.145124272 podStartE2EDuration="5.318828905s" totalImagesPullingTime="3.173704633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:59.318007923 +0000 UTC m=+511.243448247" watchObservedRunningTime="2026-09-07 12:42:59.318828905 +0000 UTC m=+511.244269209" Sep 07 12:43:05.307802 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.307773 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qqcfj" Sep 07 12:43:05.526324 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.526280 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmllx"] Sep 07 12:43:05.529582 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.529562 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jmllx" Sep 07 12:43:05.532609 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.532583 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dqj9k\"" Sep 07 12:43:05.538841 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.538820 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmllx"] Sep 07 12:43:05.617410 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.617387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snkdb\" (UniqueName: \"kubernetes.io/projected/f84a5bbe-8236-412c-b18d-296175272503-kube-api-access-snkdb\") pod \"cert-manager-55b4d954d5-jmllx\" (UID: \"f84a5bbe-8236-412c-b18d-296175272503\") " pod="cert-manager/cert-manager-55b4d954d5-jmllx" Sep 07 12:43:05.617563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.617422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f84a5bbe-8236-412c-b18d-296175272503-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmllx\" (UID: \"f84a5bbe-8236-412c-b18d-296175272503\") " pod="cert-manager/cert-manager-55b4d954d5-jmllx" Sep 07 12:43:05.718361 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.718324 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snkdb\" (UniqueName: \"kubernetes.io/projected/f84a5bbe-8236-412c-b18d-296175272503-kube-api-access-snkdb\") pod \"cert-manager-55b4d954d5-jmllx\" (UID: \"f84a5bbe-8236-412c-b18d-296175272503\") " pod="cert-manager/cert-manager-55b4d954d5-jmllx" Sep 07 12:43:05.718460 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.718366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f84a5bbe-8236-412c-b18d-296175272503-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmllx\" (UID: \"f84a5bbe-8236-412c-b18d-296175272503\") " pod="cert-manager/cert-manager-55b4d954d5-jmllx" Sep 07 12:43:05.726943 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.726913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f84a5bbe-8236-412c-b18d-296175272503-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmllx\" (UID: \"f84a5bbe-8236-412c-b18d-296175272503\") " pod="cert-manager/cert-manager-55b4d954d5-jmllx" Sep 07 12:43:05.727068 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.727047 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snkdb\" (UniqueName: \"kubernetes.io/projected/f84a5bbe-8236-412c-b18d-296175272503-kube-api-access-snkdb\") pod \"cert-manager-55b4d954d5-jmllx\" (UID: \"f84a5bbe-8236-412c-b18d-296175272503\") " pod="cert-manager/cert-manager-55b4d954d5-jmllx" Sep 07 12:43:05.839298 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:05.839235 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jmllx" Sep 07 12:43:06.112149 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:06.112114 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmllx"] Sep 07 12:43:06.115018 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:43:06.114989 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf84a5bbe_8236_412c_b18d_296175272503.slice/crio-d809857fc234dc5edb23509ee83ed0636ba0908daf225d5719c163328d7f3273 WatchSource:0}: Error finding container d809857fc234dc5edb23509ee83ed0636ba0908daf225d5719c163328d7f3273: Status 404 returned error can't find the container with id d809857fc234dc5edb23509ee83ed0636ba0908daf225d5719c163328d7f3273 Sep 07 12:43:06.329622 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:06.329582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jmllx" event={"ID":"f84a5bbe-8236-412c-b18d-296175272503","Type":"ContainerStarted","Data":"bc581f54495f9d804407391d16e7cbe8305b81462f501ea929daa23a9ed4a5df"} Sep 07 12:43:06.329622 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:06.329630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jmllx" event={"ID":"f84a5bbe-8236-412c-b18d-296175272503","Type":"ContainerStarted","Data":"d809857fc234dc5edb23509ee83ed0636ba0908daf225d5719c163328d7f3273"} Sep 07 12:43:06.345278 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:06.345230 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jmllx" podStartSLOduration=1.345214451 podStartE2EDuration="1.345214451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:43:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:43:06.344235625 +0000 UTC m=+518.269675930" watchObservedRunningTime="2026-09-07 12:43:06.345214451 +0000 UTC m=+518.270654755" Sep 07 12:43:33.234461 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.234383 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb"] Sep 07 12:43:33.237612 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.237594 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.240401 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.240369 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Sep 07 12:43:33.240401 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.240369 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Sep 07 12:43:33.240641 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.240446 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:43:33.240641 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.240477 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 07 12:43:33.240641 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.240548 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Sep 07 12:43:33.240799 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.240678 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-njctr\"" Sep 07 12:43:33.249460 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.249437 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb"] Sep 07 12:43:33.338958 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.338918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e40a0fa-6808-4f2e-8209-6cf137906e39-cert\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.339145 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.338972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mll\" (UniqueName: \"kubernetes.io/projected/3e40a0fa-6808-4f2e-8209-6cf137906e39-kube-api-access-96mll\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.339145 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.339051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e40a0fa-6808-4f2e-8209-6cf137906e39-metrics-certs\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.339145 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.339108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e40a0fa-6808-4f2e-8209-6cf137906e39-manager-config\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.439856 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.439818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e40a0fa-6808-4f2e-8209-6cf137906e39-cert\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.440043 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.439869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96mll\" (UniqueName: \"kubernetes.io/projected/3e40a0fa-6808-4f2e-8209-6cf137906e39-kube-api-access-96mll\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.440043 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.439908 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e40a0fa-6808-4f2e-8209-6cf137906e39-metrics-certs\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.440043 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.439932 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e40a0fa-6808-4f2e-8209-6cf137906e39-manager-config\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.440682 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.440657 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e40a0fa-6808-4f2e-8209-6cf137906e39-manager-config\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.442322 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.442292 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e40a0fa-6808-4f2e-8209-6cf137906e39-cert\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.442415 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.442326 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e40a0fa-6808-4f2e-8209-6cf137906e39-metrics-certs\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.450379 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.450354 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mll\" (UniqueName: \"kubernetes.io/projected/3e40a0fa-6808-4f2e-8209-6cf137906e39-kube-api-access-96mll\") pod \"jobset-controller-manager-7fdbb89cf9-jrwrb\" (UID: \"3e40a0fa-6808-4f2e-8209-6cf137906e39\") " pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.546798 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.546721 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:33.844201 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:33.844176 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb"] Sep 07 12:43:33.846738 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:43:33.846705 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e40a0fa_6808_4f2e_8209_6cf137906e39.slice/crio-41c39f69646c7017979e80266e0a281f2c15f462a38929551042403d830dee1e WatchSource:0}: Error finding container 41c39f69646c7017979e80266e0a281f2c15f462a38929551042403d830dee1e: Status 404 returned error can't find the container with id 41c39f69646c7017979e80266e0a281f2c15f462a38929551042403d830dee1e Sep 07 12:43:34.435630 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:34.435593 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" event={"ID":"3e40a0fa-6808-4f2e-8209-6cf137906e39","Type":"ContainerStarted","Data":"41c39f69646c7017979e80266e0a281f2c15f462a38929551042403d830dee1e"} Sep 07 12:43:37.449978 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:37.449936 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" event={"ID":"3e40a0fa-6808-4f2e-8209-6cf137906e39","Type":"ContainerStarted","Data":"78c18f5778048937c77179de5c768286dd06fa2135874b3f5f95a8e232255da4"} Sep 07 12:43:37.450375 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:37.450162 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:43:37.466787 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:37.466735 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" podStartSLOduration=1.862983471 podStartE2EDuration="4.466718421s" totalImagesPullingTime="2.60373495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:43:37.465119717 +0000 UTC m=+549.390560033" watchObservedRunningTime="2026-09-07 12:43:37.466718421 +0000 UTC m=+549.392158726" Sep 07 12:43:48.458446 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:43:48.458403 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-7fdbb89cf9-jrwrb" Sep 07 12:50:14.394023 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:14.393992 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5zjc4_925c9026-83d4-4471-a185-8b600a58492a/global-pull-secret-syncer/0.log" Sep 07 12:50:14.569748 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:14.569714 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9clw7_7535637d-a3cc-40d0-aec7-fdecedf5ef72/konnectivity-agent/0.log" Sep 07 12:50:14.622129 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:14.622100 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-213.ec2.internal_6ed4608990e828571d9e6032ee57e26d/haproxy/0.log" Sep 07 12:50:18.268209 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.268180 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2485d6bf-a1f4-4c53-b2af-bcfab992abcb/alertmanager/0.log" Sep 07 12:50:18.310047 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.310023 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2485d6bf-a1f4-4c53-b2af-bcfab992abcb/config-reloader/0.log" Sep 07 12:50:18.336702 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.336680 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2485d6bf-a1f4-4c53-b2af-bcfab992abcb/kube-rbac-proxy-web/0.log" Sep 07 12:50:18.365662 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.365628 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2485d6bf-a1f4-4c53-b2af-bcfab992abcb/kube-rbac-proxy/0.log" Sep 07 12:50:18.396004 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.395974 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2485d6bf-a1f4-4c53-b2af-bcfab992abcb/kube-rbac-proxy-metric/0.log" Sep 07 12:50:18.420145 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.420120 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2485d6bf-a1f4-4c53-b2af-bcfab992abcb/prom-label-proxy/0.log" Sep 07 12:50:18.448990 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.448963 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2485d6bf-a1f4-4c53-b2af-bcfab992abcb/init-config-reloader/0.log" Sep 07 12:50:18.486418 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.486385 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-sz6w9_0ef95456-5e64-4bed-ad23-4524a2ed98c9/cluster-monitoring-operator/0.log" Sep 07 12:50:18.511678 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.511649 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ksfzj_6d71f95e-c3e2-4e5b-822c-ee24385bf82b/kube-state-metrics/0.log" Sep 07 12:50:18.535603 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.535542 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ksfzj_6d71f95e-c3e2-4e5b-822c-ee24385bf82b/kube-rbac-proxy-main/0.log" Sep 07 12:50:18.559604 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.559579 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-ksfzj_6d71f95e-c3e2-4e5b-822c-ee24385bf82b/kube-rbac-proxy-self/0.log" Sep 07 12:50:18.834684 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.834606 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj2zb_e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5/node-exporter/0.log" Sep 07 12:50:18.858254 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.858231 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj2zb_e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5/kube-rbac-proxy/0.log" Sep 07 12:50:18.881679 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:18.881653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj2zb_e1248bb0-eaf9-479b-a0eb-2f6aa1dd09f5/init-textfile/0.log" Sep 07 12:50:19.218325 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:19.218295 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hw585_6f211f38-f6d3-4bfe-b556-c3e418914059/prometheus-operator/0.log" Sep 07 12:50:19.245234 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:19.245209 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hw585_6f211f38-f6d3-4bfe-b556-c3e418914059/kube-rbac-proxy/0.log" Sep 07 12:50:20.837603 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:20.837575 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-k8mph_5f290dd5-53c4-4b6b-bdaa-668ba1ab7862/networking-console-plugin/0.log" Sep 07 12:50:22.128608 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.128576 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr"] Sep 07 12:50:22.131791 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.131776 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.134319 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.134297 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh6xq\"/\"kube-root-ca.crt\"" Sep 07 12:50:22.134830 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.134811 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh6xq\"/\"openshift-service-ca.crt\"" Sep 07 12:50:22.134901 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.134811 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wh6xq\"/\"default-dockercfg-xsx9v\"" Sep 07 12:50:22.142391 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.142368 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr"] Sep 07 12:50:22.297370 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.297323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frl9m\" (UniqueName: \"kubernetes.io/projected/2620c4ab-267a-492b-824b-bd069023b3f0-kube-api-access-frl9m\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.297579 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.297459 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-podres\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.297579 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.297529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-sys\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.297579 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.297564 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-proc\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.297579 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.297579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-lib-modules\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.398728 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-podres\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.398915 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-sys\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.398915 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-proc\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.398915 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398797 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-lib-modules\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.398915 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frl9m\" (UniqueName: \"kubernetes.io/projected/2620c4ab-267a-492b-824b-bd069023b3f0-kube-api-access-frl9m\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.398915 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398864 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-podres\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.398915 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398896 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-proc\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.398915 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-sys\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.399177 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.398964 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2620c4ab-267a-492b-824b-bd069023b3f0-lib-modules\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.409000 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.408979 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frl9m\" (UniqueName: \"kubernetes.io/projected/2620c4ab-267a-492b-824b-bd069023b3f0-kube-api-access-frl9m\") pod \"perf-node-gather-daemonset-6kznr\" (UID: \"2620c4ab-267a-492b-824b-bd069023b3f0\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.441811 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.441786 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:22.711748 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:22.711722 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr"] Sep 07 12:50:22.714675 ip-10-0-128-213 kubenswrapper[2558]: W0907 12:50:22.714638 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2620c4ab_267a_492b_824b_bd069023b3f0.slice/crio-0ac50568656b1895a02321ac105effb6897ddce20ab2fd97590401189644b1d6 WatchSource:0}: Error finding container 0ac50568656b1895a02321ac105effb6897ddce20ab2fd97590401189644b1d6: Status 404 returned error can't find the container with id 0ac50568656b1895a02321ac105effb6897ddce20ab2fd97590401189644b1d6 Sep 07 12:50:23.005505 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:23.005400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" event={"ID":"2620c4ab-267a-492b-824b-bd069023b3f0","Type":"ContainerStarted","Data":"f3e1235b39b9f31ec3b6f6d550d45b691ca0548ae83b1115313b8c3cb2318f00"} Sep 07 12:50:23.005505 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:23.005453 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" event={"ID":"2620c4ab-267a-492b-824b-bd069023b3f0","Type":"ContainerStarted","Data":"0ac50568656b1895a02321ac105effb6897ddce20ab2fd97590401189644b1d6"} Sep 07 12:50:23.005698 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:23.005529 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:23.191718 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:23.191686 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fzrtk_3541b899-1ac1-4abb-8289-b30e578e1864/dns/0.log" Sep 07 12:50:23.211000 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:23.210970 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fzrtk_3541b899-1ac1-4abb-8289-b30e578e1864/kube-rbac-proxy/0.log" Sep 07 12:50:23.334345 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:23.334274 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lm4z6_ef377deb-47f7-4251-b74c-d3e770cdc31a/dns-node-resolver/0.log" Sep 07 12:50:23.751374 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:23.751344 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lnp54_ea852cfd-9f11-41eb-9526-90abd8e907b2/node-ca/0.log" Sep 07 12:50:24.556739 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:24.556710 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7c6d8f9b-2nx8t_c4ff4f17-8123-40fc-b26d-9663f69d2f98/router/0.log" Sep 07 12:50:24.938533 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:24.938503 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rx2cm_b77a1de5-5ad1-4adf-b4f5-579ac0bc5429/serve-healthcheck-canary/0.log" Sep 07 12:50:25.310959 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:25.310875 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-nrslh_b2743122-2067-4c75-91e6-6187927e3b59/insights-operator/0.log" Sep 07 12:50:25.310959 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:25.310946 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-nrslh_b2743122-2067-4c75-91e6-6187927e3b59/insights-operator/1.log" Sep 07 12:50:25.336975 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:25.336952 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tsk2_7a89c85a-e8a7-4711-8b42-c368f0521ca8/kube-rbac-proxy/0.log" Sep 07 12:50:25.360546 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:25.360522 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tsk2_7a89c85a-e8a7-4711-8b42-c368f0521ca8/exporter/0.log" Sep 07 12:50:25.382922 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:25.382900 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tsk2_7a89c85a-e8a7-4711-8b42-c368f0521ca8/extractor/0.log" Sep 07 12:50:27.165905 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:27.165878 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-7fdbb89cf9-jrwrb_3e40a0fa-6808-4f2e-8209-6cf137906e39/manager/0.log" Sep 07 12:50:29.019316 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:29.019288 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" Sep 07 12:50:29.038338 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:29.038290 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-6kznr" podStartSLOduration=7.038272922 podStartE2EDuration="7.038272922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:50:23.021040946 +0000 UTC m=+954.946481280" watchObservedRunningTime="2026-09-07 12:50:29.038272922 +0000 UTC m=+960.963713225" Sep 07 12:50:31.993586 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:31.993556 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjqkf_028404bc-6452-4d60-8962-cd8f899f8fdf/kube-multus-additional-cni-plugins/0.log" Sep 07 12:50:32.023935 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.023898 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjqkf_028404bc-6452-4d60-8962-cd8f899f8fdf/egress-router-binary-copy/0.log" Sep 07 12:50:32.046117 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.046093 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjqkf_028404bc-6452-4d60-8962-cd8f899f8fdf/cni-plugins/0.log" Sep 07 12:50:32.070385 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.070360 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjqkf_028404bc-6452-4d60-8962-cd8f899f8fdf/bond-cni-plugin/0.log" Sep 07 12:50:32.095127 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.095102 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjqkf_028404bc-6452-4d60-8962-cd8f899f8fdf/routeoverride-cni/0.log" Sep 07 12:50:32.118038 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.118018 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjqkf_028404bc-6452-4d60-8962-cd8f899f8fdf/whereabouts-cni-bincopy/0.log" Sep 07 12:50:32.145900 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.145882 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjqkf_028404bc-6452-4d60-8962-cd8f899f8fdf/whereabouts-cni/0.log" Sep 07 12:50:32.606300 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.606271 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xclkq_06780cd0-e441-458b-b371-d13377d92f6c/kube-multus/0.log" Sep 07 12:50:32.784984 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.784908 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p8mnv_5e722016-4e1c-4cd0-80cb-19d044cc821e/network-metrics-daemon/0.log" Sep 07 12:50:32.808714 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:32.808690 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p8mnv_5e722016-4e1c-4cd0-80cb-19d044cc821e/kube-rbac-proxy/0.log" Sep 07 12:50:33.603517 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:33.603475 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b7xfc_28179a4f-4934-4d40-ab4b-446a0a9b0d5e/ovn-controller/0.log" Sep 07 12:50:33.624592 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:33.624569 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b7xfc_28179a4f-4934-4d40-ab4b-446a0a9b0d5e/ovn-acl-logging/0.log" Sep 07 12:50:33.653624 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:33.653602 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b7xfc_28179a4f-4934-4d40-ab4b-446a0a9b0d5e/kube-rbac-proxy-node/0.log" Sep 07 12:50:33.678563 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:33.678524 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b7xfc_28179a4f-4934-4d40-ab4b-446a0a9b0d5e/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 12:50:33.695798 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:33.695772 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b7xfc_28179a4f-4934-4d40-ab4b-446a0a9b0d5e/northd/0.log" Sep 07 12:50:33.718960 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:33.718939 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b7xfc_28179a4f-4934-4d40-ab4b-446a0a9b0d5e/nbdb/0.log" Sep 07 12:50:33.742113 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:33.742077 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b7xfc_28179a4f-4934-4d40-ab4b-446a0a9b0d5e/sbdb/0.log" Sep 07 12:50:33.777784 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:33.777761 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b7xfc_28179a4f-4934-4d40-ab4b-446a0a9b0d5e/ovnkube-controller/0.log" Sep 07 12:50:35.448943 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:35.448909 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9zw99_9b246143-b890-4fcb-bc09-70276a79f00d/network-check-target-container/0.log" Sep 07 12:50:36.477897 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:36.477869 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-mvhcz_48073f83-c67b-4245-abf9-2cd1b66e77d6/iptables-alerter/0.log" Sep 07 12:50:37.141974 ip-10-0-128-213 kubenswrapper[2558]: I0907 12:50:37.141944 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-mwmpw_560e36eb-1307-4281-8d72-48e17f8f5182/tuned/0.log"