Jul 27 23:58:55.819853 ip-10-0-140-17 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 23:58:55.819866 ip-10-0-140-17 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 23:58:55.819875 ip-10-0-140-17 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 23:58:55.820171 ip-10-0-140-17 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 23:59:06.020046 ip-10-0-140-17 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 23:59:06.020064 ip-10-0-140-17 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot bfc6f4dc6b4841778a96675f6d3844e4 -- Jul 28 00:00:58.217934 ip-10-0-140-17 systemd[1]: Starting Kubernetes Kubelet... Jul 28 00:00:58.624864 ip-10-0-140-17 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:00:58.624864 ip-10-0-140-17 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 00:00:58.624864 ip-10-0-140-17 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:00:58.624864 ip-10-0-140-17 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 00:00:58.625419 ip-10-0-140-17 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:00:58.625662 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.625594 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 00:00:58.630115 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630100 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:00:58.630115 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630115 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630119 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630122 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630125 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630128 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630131 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630134 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630137 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630140 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630143 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630147 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630149 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630152 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630155 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630160 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630165 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630169 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630172 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630175 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630178 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:00:58.630178 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630181 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630183 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630187 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630189 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630192 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630195 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630197 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630201 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630203 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630206 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630208 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630211 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630213 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630216 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630219 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630221 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630223 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630226 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630229 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630233 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:00:58.630631 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630235 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630238 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630240 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630243 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630245 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630248 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630250 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630253 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630256 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630260 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630263 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630266 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630269 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630271 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630275 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630278 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630281 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630284 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630287 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:00:58.631116 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630289 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630292 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630295 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630297 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630300 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630302 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630305 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630307 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630310 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630312 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630315 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630318 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630321 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630323 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630325 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630328 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630330 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630333 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630335 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630338 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:00:58.631592 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630340 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630343 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630346 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630349 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630351 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630354 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630356 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630361 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630364 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630366 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630369 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630371 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630374 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630377 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630379 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630382 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630384 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630387 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.630390 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:00:58.632177 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631092 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631098 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631101 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631104 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631108 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631113 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631116 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631119 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631122 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631125 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631128 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631131 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631133 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631136 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631139 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631141 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631144 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631147 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631151 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:00:58.632617 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631154 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631158 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631161 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631164 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631167 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631170 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631173 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631176 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631179 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631181 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631184 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631187 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631189 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631192 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631195 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631197 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631200 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631202 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631205 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:00:58.633090 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631208 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631210 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631213 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631215 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631218 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631220 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631223 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631226 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631228 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631230 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631233 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631236 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631238 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631241 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631243 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631246 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631249 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631251 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631254 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631257 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:00:58.633537 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631261 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631265 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631268 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631270 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631273 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631275 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631278 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631280 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631283 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631285 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631288 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631290 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631293 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631296 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631299 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631302 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631305 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631308 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631311 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631313 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:00:58.634023 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631316 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631318 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631321 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631323 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631326 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631328 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631331 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631333 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631336 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631338 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631341 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631343 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631345 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631348 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631351 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631354 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631356 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631359 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631361 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631364 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:00:58.634502 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631366 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631713 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631718 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631721 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631725 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631729 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631732 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631735 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631738 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631741 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631744 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631747 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631749 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631752 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631754 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631757 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631759 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631762 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631764 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:00:58.634984 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631767 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631770 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631772 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631775 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631777 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631780 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631782 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631784 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631787 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631789 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631792 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631794 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631796 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631799 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631801 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631804 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631806 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631808 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631810 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631813 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:00:58.635434 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631818 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631820 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631823 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631825 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631828 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631830 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631833 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631835 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631838 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631841 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631843 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631845 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631848 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631850 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631853 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631855 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631858 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631860 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631863 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:00:58.635951 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631865 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631868 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631872 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631875 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631878 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631881 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631884 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631886 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631889 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631891 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631895 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631897 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631899 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631904 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631906 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631909 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631911 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631914 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631916 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631919 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:00:58.636392 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631921 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631924 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631926 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631929 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631931 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631934 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631937 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631940 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631942 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631945 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631947 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631950 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631952 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631955 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631957 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631960 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631962 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631965 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631967 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631970 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:00:58.636914 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631973 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.631975 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632043 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632049 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632054 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632060 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632064 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632068 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632072 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632076 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632079 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632082 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632085 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632088 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632092 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632094 2558 flags.go:64] FLAG: --cgroup-root="" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632097 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632100 2558 flags.go:64] FLAG: --client-ca-file="" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632103 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632106 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632111 2558 flags.go:64] FLAG: --cluster-domain="" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632113 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632116 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632120 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 00:00:58.637372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632123 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632126 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632129 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632132 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632135 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632139 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632142 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632145 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632148 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632151 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632155 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632158 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632161 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632165 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632168 2558 flags.go:64] FLAG: --enable-server="true" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632172 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632175 2558 flags.go:64] FLAG: --event-burst="100" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632178 2558 flags.go:64] FLAG: --event-qps="50" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632181 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632184 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632187 2558 flags.go:64] FLAG: --eviction-hard="" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632191 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632194 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632199 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632202 2558 flags.go:64] FLAG: --eviction-soft="" Jul 28 00:00:58.637938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632205 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632208 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632211 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632214 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632217 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632220 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632222 2558 flags.go:64] FLAG: --feature-gates="" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632226 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632229 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632232 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632235 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632238 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632241 2558 flags.go:64] FLAG: --help="false" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632244 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-140-17.ec2.internal" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632247 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632250 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632252 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632255 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632259 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632261 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632266 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632268 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632271 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 00:00:58.638519 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632274 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632278 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632280 2558 flags.go:64] FLAG: --kube-reserved="" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632283 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632286 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632289 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632292 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632296 2558 flags.go:64] FLAG: --lock-file="" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632300 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632303 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632306 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632311 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632314 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632316 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632319 2558 flags.go:64] FLAG: --logging-format="text" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632322 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632325 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632328 2558 flags.go:64] FLAG: --manifest-url="" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632331 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632335 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632337 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632341 2558 flags.go:64] FLAG: --max-pods="110" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632344 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632347 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632349 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 00:00:58.639133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632352 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632355 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632358 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632361 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632368 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632372 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632375 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632377 2558 flags.go:64] FLAG: --pod-cidr="" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632381 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632385 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632388 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632391 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632394 2558 flags.go:64] FLAG: --port="10250" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632397 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632401 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-011665595d1398b77" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632404 2558 flags.go:64] FLAG: --qos-reserved="" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632407 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632410 2558 flags.go:64] FLAG: --register-node="true" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632412 2558 flags.go:64] FLAG: --register-with-taints="" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632416 2558 flags.go:64] FLAG: --registry-burst="10" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632418 2558 flags.go:64] FLAG: --registry-qps="5" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632421 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632424 2558 flags.go:64] FLAG: --reserved-memory="" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632427 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632430 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 00:00:58.639753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632433 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632436 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632438 2558 flags.go:64] FLAG: --runonce="false" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632441 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632444 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632446 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632449 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632452 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632454 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632457 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632460 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632463 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632468 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632471 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632474 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632477 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632480 2558 flags.go:64] FLAG: --system-cgroups="" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632483 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632488 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632491 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632493 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632498 2558 flags.go:64] FLAG: --tls-min-version="" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632501 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632504 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632507 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 00:00:58.640351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632510 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632513 2558 flags.go:64] FLAG: --v="2" Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632517 2558 flags.go:64] FLAG: --version="false" Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632520 2558 flags.go:64] FLAG: --vmodule="" Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632524 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.632527 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632629 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632632 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632635 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632638 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632641 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632644 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632646 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632649 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632651 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632654 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632656 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632659 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632674 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632677 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632682 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:00:58.640956 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632685 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632688 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632691 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632694 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632696 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632699 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632701 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632707 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632710 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632713 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632716 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632718 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632721 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632724 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632726 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632729 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632732 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632734 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632736 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:00:58.641444 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632739 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632742 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632744 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632746 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632749 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632751 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632754 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632756 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632758 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632761 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632763 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632766 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632769 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632771 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632774 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632776 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632779 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632788 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632791 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632793 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:00:58.641909 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632797 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632800 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632803 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632805 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632808 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632810 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632813 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632815 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632818 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632821 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632823 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632826 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632828 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632831 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632834 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632836 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632839 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632841 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632844 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632846 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:00:58.642380 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632849 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632851 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632854 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632856 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632859 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632861 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632864 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632866 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632868 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632871 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632874 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632876 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632880 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632883 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632886 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632888 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632890 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632893 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632895 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632898 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:00:58.642863 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632900 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632903 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632905 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632909 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.632912 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.633699 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.640416 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.640433 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.641343 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.641351 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641412 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641417 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641421 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641424 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:00:58.643331 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641427 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641429 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641432 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641435 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641439 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641442 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641445 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641448 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641451 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641454 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641457 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641460 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641462 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641465 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641468 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641471 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641473 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641476 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641478 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:00:58.643721 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641482 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641486 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641489 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641492 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641495 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641497 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641505 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641508 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641511 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641514 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641517 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641519 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641522 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641524 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641527 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641529 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641532 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641535 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641537 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641540 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:00:58.644169 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641542 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641544 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641547 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641550 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641552 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641555 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641557 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641559 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641562 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641564 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641567 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641569 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641572 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641574 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641577 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641580 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641583 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641585 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641587 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:00:58.644677 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641595 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641598 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641600 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641603 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641605 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641608 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641610 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641613 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641615 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641617 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641620 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641623 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641625 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641628 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641630 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641633 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641635 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641638 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641640 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641643 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:00:58.645119 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641645 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641647 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641650 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641654 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641657 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641660 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641675 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641679 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641682 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641685 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641688 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641690 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641693 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641702 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641704 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641707 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:00:58.645580 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641709 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.641715 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641866 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641871 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641874 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641877 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641880 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641882 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641885 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641887 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641890 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641893 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641895 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641898 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641900 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:00:58.645972 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641903 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641905 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641908 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641911 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641913 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641916 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641918 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641921 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641923 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641926 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641929 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641932 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641934 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641937 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641939 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641948 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641951 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641953 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641955 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641958 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:00:58.646340 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641961 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641963 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641966 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641968 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641970 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641973 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641975 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641977 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641980 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641982 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641985 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641988 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641990 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641992 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641995 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641997 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.641999 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642002 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642004 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:00:58.646948 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642006 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642009 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642012 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642015 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642017 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642020 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642023 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642026 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642028 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642036 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642038 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642041 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642043 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642046 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642048 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642051 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642054 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642056 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642058 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:00:58.647395 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642061 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642063 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642065 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642068 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642070 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642073 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642075 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642077 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642085 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642089 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642091 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642093 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642096 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642099 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642101 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642104 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642107 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642110 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642114 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:00:58.647844 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642118 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642121 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642124 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642127 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642137 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642140 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642143 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642145 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:58.642148 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.642153 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.642270 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.646778 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.648022 2558 server.go:1019] "Starting client certificate rotation" Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.648121 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:00:58.648345 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.648182 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:00:58.653492 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.653468 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:00:58.657564 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.657547 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:00:58.665612 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.665598 2558 log.go:25] "Validated CRI v1 runtime API" Jul 28 00:00:58.667595 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.667582 2558 log.go:25] "Validated CRI v1 image API" Jul 28 00:00:58.669261 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.669245 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 00:00:58.671445 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.671428 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9e7fbc67-20bc-4853-84c1-74d37792ba25:/dev/nvme0n1p3 de8fa70b-0b14-4cbf-8818-b6090939e2f0:/dev/nvme0n1p4] Jul 28 00:00:58.671489 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.671446 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 00:00:58.677180 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.677084 2558 manager.go:216] Machine: {Timestamp:2026-07-28 00:00:58.675793629 +0000 UTC m=+0.339771617 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202202 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29ff9e76c778725a088573e7aaecf0 SystemUUID:ec29ff9e-76c7-7872-5a08-8573e7aaecf0 BootID:bfc6f4dc-6b48-4177-8a96-675f6d3844e4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d5:40:b9:94:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d5:40:b9:94:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:fc:1b:51:f4:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 00:00:58.677180 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.677176 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 00:00:58.677267 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.677241 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 00:00:58.678218 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.678198 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 00:00:58.678345 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.678219 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 00:00:58.680998 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.680987 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 00:00:58.681030 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.681001 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 00:00:58.681030 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.681008 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:00:58.681796 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.681786 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:00:58.683204 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.683193 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 00:00:58.686001 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.685991 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:00:58.686118 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.686108 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 00:00:58.686768 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.686758 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 28 00:00:58.686797 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.686773 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 00:00:58.686797 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.686788 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 00:00:58.686797 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.686797 2558 kubelet.go:398] "Adding apiserver pod source" Jul 28 00:00:58.686881 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.686806 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 00:00:58.687127 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.687109 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:00:58.687256 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.687133 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:00:58.690356 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.690310 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 00:00:58.692014 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.691997 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:00:58.692161 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.692146 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 00:00:58.692205 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.692176 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 00:00:58.693196 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693185 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 00:00:58.693243 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693200 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 00:00:58.693243 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693206 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 00:00:58.693243 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693211 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 00:00:58.693243 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693219 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 00:00:58.693243 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693224 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 00:00:58.693243 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693231 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 00:00:58.693243 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693236 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 00:00:58.693243 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693243 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 00:00:58.693450 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693248 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 00:00:58.693450 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693256 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 00:00:58.693450 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693261 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 00:00:58.693945 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693935 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 00:00:58.693945 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.693944 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 00:00:58.698472 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.698457 2558 server.go:1268] "Started kubelet" Jul 28 00:00:58.698714 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.698625 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 00:00:58.698808 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.698733 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 00:00:58.699220 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.699170 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 00:00:58.699337 ip-10-0-140-17 systemd[1]: Started Kubernetes Kubelet. Jul 28 00:00:58.700409 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.700307 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 00:00:58.700585 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.700564 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 00:00:58.700585 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.700562 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 00:00:58.700739 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.700716 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 00:00:58.700914 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.700901 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 28 00:00:58.703711 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.702796 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-17.ec2.internal.18c64b15a8dc98ca default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-17.ec2.internal,UID:ip-10-0-140-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-17.ec2.internal,},FirstTimestamp:2026-07-28 00:00:58.69840609 +0000 UTC m=+0.362384079,LastTimestamp:2026-07-28 00:00:58.69840609 +0000 UTC m=+0.362384079,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-17.ec2.internal,}" Jul 28 00:00:58.704620 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.704604 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 00:00:58.707005 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.706940 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 00:00:58.707005 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.706961 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 00:00:58.707121 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.707077 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:58.707882 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.707854 2558 factory.go:55] Registering systemd factory Jul 28 00:00:58.707882 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.707872 2558 factory.go:223] Registration of the systemd container factory successfully Jul 28 00:00:58.708032 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.707857 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 00:00:58.708032 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.707904 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 00:00:58.708032 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.707858 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 00:00:58.708151 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.708041 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 28 00:00:58.708151 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.708047 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 28 00:00:58.708151 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.708074 2558 factory.go:153] Registering CRI-O factory Jul 28 00:00:58.708151 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.708088 2558 factory.go:223] Registration of the crio container factory successfully Jul 28 00:00:58.708151 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.708137 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 00:00:58.708357 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.708158 2558 factory.go:103] Registering Raw factory Jul 28 00:00:58.708357 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.708170 2558 manager.go:1196] Started watching for new ooms in manager Jul 28 00:00:58.708838 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.708821 2558 manager.go:349] Starting recovery of all containers Jul 28 00:00:58.709198 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.709173 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 00:00:58.709300 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.709268 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 00:00:58.718610 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.718594 2558 manager.go:354] Recovery completed Jul 28 00:00:58.725312 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.725298 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:00:58.727100 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.727073 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:00:58.727197 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.727111 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:00:58.727197 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.727121 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:00:58.727628 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.727597 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 00:00:58.727628 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.727612 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 00:00:58.727628 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.727630 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:00:58.727814 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.727613 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:00:58.728337 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.728319 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:00:58.728409 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.728345 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:00:58.728409 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.728356 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:00:58.729334 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.729320 2558 policy_none.go:49] "None policy: Start" Jul 28 00:00:58.729407 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.729338 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 00:00:58.729407 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.729352 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 00:00:58.730275 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.730263 2558 policy_none.go:47] "Start" Jul 28 00:00:58.736549 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.736398 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-17.ec2.internal.18c64b15aa926692 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-17.ec2.internal,UID:ip-10-0-140-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-17.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-17.ec2.internal,},FirstTimestamp:2026-07-28 00:00:58.727098002 +0000 UTC m=+0.391075994,LastTimestamp:2026-07-28 00:00:58.727098002 +0000 UTC m=+0.391075994,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-17.ec2.internal,}" Jul 28 00:00:58.740187 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.740131 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-17.ec2.internal.18c64b15aa92ab07 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-17.ec2.internal,UID:ip-10-0-140-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-17.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-17.ec2.internal,},FirstTimestamp:2026-07-28 00:00:58.727115527 +0000 UTC m=+0.391093515,LastTimestamp:2026-07-28 00:00:58.727115527 +0000 UTC m=+0.391093515,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-17.ec2.internal,}" Jul 28 00:00:58.747289 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.747219 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-17.ec2.internal.18c64b15aa92cd92 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-17.ec2.internal,UID:ip-10-0-140-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-17.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-17.ec2.internal,},FirstTimestamp:2026-07-28 00:00:58.72712437 +0000 UTC m=+0.391102359,LastTimestamp:2026-07-28 00:00:58.72712437 +0000 UTC m=+0.391102359,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-17.ec2.internal,}" Jul 28 00:00:58.749561 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.749537 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ss7lh" Jul 28 00:00:58.757284 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.757269 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ss7lh" Jul 28 00:00:58.758858 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.758798 2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-17.ec2.internal.18c64b15aa926692\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-17.ec2.internal.18c64b15aa926692 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-17.ec2.internal,UID:ip-10-0-140-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-17.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-17.ec2.internal,},FirstTimestamp:2026-07-28 00:00:58.727098002 +0000 UTC m=+0.391075994,LastTimestamp:2026-07-28 00:00:58.728333035 +0000 UTC m=+0.392311024,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-17.ec2.internal,}" Jul 28 00:00:58.771198 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.771184 2558 manager.go:337] "Starting Device Plugin manager" Jul 28 00:00:58.771282 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.771213 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 00:00:58.771282 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.771222 2558 server.go:87] "Starting device plugin registration server" Jul 28 00:00:58.771410 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.771397 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 00:00:58.771457 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.771412 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 00:00:58.771509 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.771469 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 00:00:58.771556 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.771542 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 00:00:58.771556 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.771550 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 00:00:58.771981 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.771963 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 00:00:58.772064 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.772021 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:58.859176 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.859145 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 00:00:58.860273 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.860257 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 00:00:58.860322 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.860299 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 00:00:58.860354 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.860324 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 00:00:58.860390 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.860361 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 00:00:58.862767 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.862751 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:00:58.871908 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.871894 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:00:58.872583 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.872571 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:00:58.872641 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.872596 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:00:58.872641 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.872605 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:00:58.872641 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.872622 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-17.ec2.internal" Jul 28 00:00:58.881608 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.881574 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-17.ec2.internal" Jul 28 00:00:58.881608 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.881593 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-17.ec2.internal\": node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:58.911230 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.911211 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:58.960621 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.960600 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal"] Jul 28 00:00:58.960715 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.960660 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:00:58.962158 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.962144 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:00:58.962223 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.962174 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:00:58.962223 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.962183 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:00:58.963543 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.963529 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:00:58.963653 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.963637 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:58.963702 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.963684 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:00:58.964181 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.964168 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:00:58.964255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.964180 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:00:58.964255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.964198 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:00:58.964255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.964207 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:00:58.964255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.964198 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:00:58.964363 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.964276 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:00:58.965444 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.965430 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" Jul 28 00:00:58.965526 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.965455 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:00:58.966093 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.966062 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:00:58.966176 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.966097 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:00:58.966176 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:58.966109 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:00:58.990245 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.990226 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-17.ec2.internal\" not found" node="ip-10-0-140-17.ec2.internal" Jul 28 00:00:58.994333 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:58.994319 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-17.ec2.internal\" not found" node="ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.011617 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:59.011600 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:59.109295 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.109276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82e831ea1e0a8337ebcffdb7c227d0e6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-17.ec2.internal\" (UID: \"82e831ea1e0a8337ebcffdb7c227d0e6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.109366 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.109310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb13ac6284e244a084caf6e618d9237e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal\" (UID: \"cb13ac6284e244a084caf6e618d9237e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.109366 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.109337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb13ac6284e244a084caf6e618d9237e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal\" (UID: \"cb13ac6284e244a084caf6e618d9237e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.112522 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:59.112507 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:59.209969 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.209922 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82e831ea1e0a8337ebcffdb7c227d0e6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-17.ec2.internal\" (UID: \"82e831ea1e0a8337ebcffdb7c227d0e6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.209969 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.209883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82e831ea1e0a8337ebcffdb7c227d0e6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-17.ec2.internal\" (UID: \"82e831ea1e0a8337ebcffdb7c227d0e6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.210056 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.209994 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb13ac6284e244a084caf6e618d9237e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal\" (UID: \"cb13ac6284e244a084caf6e618d9237e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.210056 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.210016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb13ac6284e244a084caf6e618d9237e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal\" (UID: \"cb13ac6284e244a084caf6e618d9237e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.210056 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.210052 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb13ac6284e244a084caf6e618d9237e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal\" (UID: \"cb13ac6284e244a084caf6e618d9237e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.210144 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.210089 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb13ac6284e244a084caf6e618d9237e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal\" (UID: \"cb13ac6284e244a084caf6e618d9237e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.213168 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:59.213147 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:59.298885 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.298854 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.298885 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.298875 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.313410 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:59.313391 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:59.414247 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:59.414225 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:59.515149 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:59.515098 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:59.615235 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:00:59.615211 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-17.ec2.internal\" not found" Jul 28 00:00:59.628285 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.628260 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:00:59.648039 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.648018 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 00:00:59.648154 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.648135 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 00:00:59.648205 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.648189 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 00:00:59.705358 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.705336 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:00:59.707062 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.707045 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 00:00:59.707478 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.707453 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.718725 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.718704 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:00:59.721407 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.721386 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:00:59.722450 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.722436 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" Jul 28 00:00:59.728778 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.728761 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:00:59.743879 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.743716 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-754bk" Jul 28 00:00:59.753835 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.753819 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-754bk" Jul 28 00:00:59.761231 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.761204 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 23:55:59 +0000 UTC" deadline="2027-12-23 12:54:08.71380218 +0000 UTC" Jul 28 00:00:59.761231 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.761228 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12324h53m8.9525769s" Jul 28 00:00:59.853045 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:59.853016 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e831ea1e0a8337ebcffdb7c227d0e6.slice/crio-e8296a4beb1868fa49035ffc4d9a044378ce96df3d0258539cb0319cb5e0ace3 WatchSource:0}: Error finding container e8296a4beb1868fa49035ffc4d9a044378ce96df3d0258539cb0319cb5e0ace3: Status 404 returned error can't find the container with id e8296a4beb1868fa49035ffc4d9a044378ce96df3d0258539cb0319cb5e0ace3 Jul 28 00:00:59.853450 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:00:59.853428 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb13ac6284e244a084caf6e618d9237e.slice/crio-b9881d77d665fb2df79272484488c4565848ddbd6cdf7e3cca7a13dfa713c9e7 WatchSource:0}: Error finding container b9881d77d665fb2df79272484488c4565848ddbd6cdf7e3cca7a13dfa713c9e7: Status 404 returned error can't find the container with id b9881d77d665fb2df79272484488c4565848ddbd6cdf7e3cca7a13dfa713c9e7 Jul 28 00:00:59.859693 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.859669 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:00:59.863309 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.863265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" event={"ID":"82e831ea1e0a8337ebcffdb7c227d0e6","Type":"ContainerStarted","Data":"e8296a4beb1868fa49035ffc4d9a044378ce96df3d0258539cb0319cb5e0ace3"} Jul 28 00:00:59.864263 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:00:59.864239 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" event={"ID":"cb13ac6284e244a084caf6e618d9237e","Type":"ContainerStarted","Data":"b9881d77d665fb2df79272484488c4565848ddbd6cdf7e3cca7a13dfa713c9e7"} Jul 28 00:01:00.182791 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.182735 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:00.687831 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.687799 2558 apiserver.go:52] "Watching apiserver" Jul 28 00:01:00.695257 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.695228 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 00:01:00.696675 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.696648 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2q8nf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp","openshift-multus/multus-wlk4t","openshift-network-operator/iptables-alerter-8wdmt","openshift-ovn-kubernetes/ovnkube-node-t4vmm","kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2gj6b","openshift-dns/node-resolver-zrkn7","openshift-image-registry/node-ca-76s8v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal","openshift-multus/multus-additional-cni-plugins-gz24k","openshift-multus/network-metrics-daemon-dtwj5","openshift-network-diagnostics/network-check-target-8vf2s","kube-system/global-pull-secret-syncer-b8mns"] Jul 28 00:01:00.698202 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.698178 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.699852 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.699825 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:00.699973 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.699900 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:00.700774 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.700443 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 00:01:00.700774 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.700493 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:01:00.700972 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.700946 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wjxtz\"" Jul 28 00:01:00.701928 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.701907 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.703476 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.703298 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.704148 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.704121 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 00:01:00.704436 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.704421 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 00:01:00.704529 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.704462 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 00:01:00.704587 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.704571 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7wn8v\"" Jul 28 00:01:00.704798 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.704781 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 00:01:00.704880 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.704867 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.705037 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.705018 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:01:00.705629 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.705610 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 00:01:00.705629 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.705623 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fwvxj\"" Jul 28 00:01:00.705849 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.705722 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 00:01:00.706178 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.706158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.706273 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.706229 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:00.707667 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.707648 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jrr74\"" Jul 28 00:01:00.707910 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.707891 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 00:01:00.708576 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.708557 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 00:01:00.708657 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.708642 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.708798 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.708779 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 00:01:00.709345 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.709326 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 00:01:00.709585 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.709559 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 00:01:00.709907 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.709889 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:00.710349 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.710314 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 00:01:00.711552 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.711530 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xvwpk\"" Jul 28 00:01:00.712223 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.712205 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 00:01:00.712824 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.712588 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pjqgq\"" Jul 28 00:01:00.712824 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.712652 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 00:01:00.713617 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.713151 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 00:01:00.713617 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.713423 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 00:01:00.713617 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.713510 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 00:01:00.713833 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.713649 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.715520 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.715498 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.717174 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.717154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.717274 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.717255 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 00:01:00.717728 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.717375 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 00:01:00.717728 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.717588 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 00:01:00.717889 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.717826 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 00:01:00.717889 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.717866 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mbrnn\"" Jul 28 00:01:00.718051 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.718033 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nns64\"" Jul 28 00:01:00.718154 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.718062 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 00:01:00.718730 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.718713 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:00.718833 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.718800 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:00.719070 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:00.719157 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719080 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-lib-modules\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.719157 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719105 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d17ec1a-0b7b-4180-85a6-a8d521015c38-tmp\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.719324 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-cni-bin\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.719420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719350 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 00:01:00.719420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.719530 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nvw6\" (UniqueName: \"kubernetes.io/projected/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-kube-api-access-4nvw6\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.719530 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719435 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 00:01:00.719530 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysctl-d\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.719718 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719566 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ccq6d\"" Jul 28 00:01:00.719798 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4448a632-9359-4650-9c0f-4778b59e235c-multus-daemon-config\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.719798 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719769 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-host\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.719894 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719794 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mh2w\" (UniqueName: \"kubernetes.io/projected/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-kube-api-access-2mh2w\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.719894 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-run-netns\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.719894 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-var-lib-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.719894 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-host\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.719894 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719887 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f2549e0-1b4c-4075-895a-307dfb86bf78-agent-certs\") pod \"konnectivity-agent-2q8nf\" (UID: \"1f2549e0-1b4c-4075-895a-307dfb86bf78\") " pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:00.720136 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brfcd\" (UniqueName: \"kubernetes.io/projected/4448a632-9359-4650-9c0f-4778b59e235c-kube-api-access-brfcd\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.720136 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719935 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-serviceca\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.720136 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.719983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovnkube-config\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.720136 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720007 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a26ab917-2327-4c6d-ba63-f3310f7e9347-host-slash\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.720136 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-kubelet\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.720136 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720077 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-systemd\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.720136 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d75b25e5-477e-4784-956b-672905da91a3-dbus\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-kubernetes\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f2549e0-1b4c-4075-895a-307dfb86bf78-konnectivity-ca\") pod \"konnectivity-agent-2q8nf\" (UID: \"1f2549e0-1b4c-4075-895a-307dfb86bf78\") " pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-netns\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-ovn\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720239 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-log-socket\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysctl-conf\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwjv\" (UniqueName: \"kubernetes.io/projected/4d17ec1a-0b7b-4180-85a6-a8d521015c38-kube-api-access-dmwjv\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720324 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-system-cni-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-cni-multus\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkscv\" (UniqueName: \"kubernetes.io/projected/a26ab917-2327-4c6d-ba63-f3310f7e9347-kube-api-access-tkscv\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-node-log\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-cni-bin\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.720477 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720474 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-tuned\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a26ab917-2327-4c6d-ba63-f3310f7e9347-iptables-alerter-script\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-etc-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-cni-netd\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720660 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovnkube-script-lib\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720704 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysconfig\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720752 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-sys\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-env-overrides\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-var-lib-kubelet\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-cni-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720862 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-systemd-units\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-slash\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.720968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-run\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-cnibin\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4448a632-9359-4650-9c0f-4778b59e235c-cni-binary-copy\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721099 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-os-release\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-k8s-cni-cncf-io\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-modprobe-d\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-systemd\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-socket-dir-parent\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-kubelet\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721297 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-hostroot\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-multus-certs\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-etc-kubernetes\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d75b25e5-477e-4784-956b-672905da91a3-kubelet-config\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.721939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.721412 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-conf-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.755829 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.755787 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 23:56:00 +0000 UTC" deadline="2027-12-21 04:53:12.142267171 +0000 UTC" Jul 28 00:01:00.755829 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.755829 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12268h52m11.386442869s" Jul 28 00:01:00.809393 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.809371 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 00:01:00.822753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovnkube-config\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.822866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822767 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-hosts-file\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.822866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822795 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.822866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a26ab917-2327-4c6d-ba63-f3310f7e9347-host-slash\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.822866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-kubelet\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823093 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822885 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-systemd\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823093 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822918 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d75b25e5-477e-4784-956b-672905da91a3-dbus\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.823093 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-kubernetes\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.823093 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.822980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f2549e0-1b4c-4075-895a-307dfb86bf78-konnectivity-ca\") pod \"konnectivity-agent-2q8nf\" (UID: \"1f2549e0-1b4c-4075-895a-307dfb86bf78\") " pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:00.823093 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-netns\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.823093 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-ovn\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823375 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-log-socket\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823375 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-sys-fs\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.823375 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.823375 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysctl-conf\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.823375 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwjv\" (UniqueName: \"kubernetes.io/projected/4d17ec1a-0b7b-4180-85a6-a8d521015c38-kube-api-access-dmwjv\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.823375 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-system-cni-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.823375 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823321 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-cni-multus\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkscv\" (UniqueName: \"kubernetes.io/projected/a26ab917-2327-4c6d-ba63-f3310f7e9347-kube-api-access-tkscv\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-node-log\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-cni-bin\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-tuned\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a26ab917-2327-4c6d-ba63-f3310f7e9347-iptables-alerter-script\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-etc-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-cni-netd\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823574 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovnkube-config\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823585 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovnkube-script-lib\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823603 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-socket-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823664 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-tmp-dir\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.823708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823667 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-kubelet\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823714 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a26ab917-2327-4c6d-ba63-f3310f7e9347-host-slash\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823784 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-kubernetes\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823790 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-node-log\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823799 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-log-socket\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823951 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-systemd\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.823985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysconfig\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824017 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-sys\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-env-overrides\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824132 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824193 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysctl-conf\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-var-lib-kubelet\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824233 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824270 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d75b25e5-477e-4784-956b-672905da91a3-dbus\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824302 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-cni-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824361 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-sys\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824409 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824509 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-cni-multus\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.825214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824577 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-ovn\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824238 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-cni-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824695 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-systemd-units\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-slash\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824845 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztv75\" (UniqueName: \"kubernetes.io/projected/18c495b6-909a-464c-818e-4dfd46285873-kube-api-access-ztv75\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824909 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-etc-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824923 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-netns\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-run\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824967 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-cni-netd\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824875 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-env-overrides\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.824984 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-system-cni-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-cnibin\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825052 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysconfig\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4448a632-9359-4650-9c0f-4778b59e235c-cni-binary-copy\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825108 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-cnibin\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.826328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-os-release\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825156 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-var-lib-kubelet\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwm6\" (UniqueName: \"kubernetes.io/projected/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-kube-api-access-lbwm6\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825111 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-cni-bin\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825256 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-run\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-os-release\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825298 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovnkube-script-lib\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825314 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-slash\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825318 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-k8s-cni-cncf-io\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825346 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825367 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-run-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-registration-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-system-cni-dir\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825611 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-modprobe-d\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-systemd\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825689 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f2549e0-1b4c-4075-895a-307dfb86bf78-konnectivity-ca\") pod \"konnectivity-agent-2q8nf\" (UID: \"1f2549e0-1b4c-4075-895a-307dfb86bf78\") " pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:00.827321 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825718 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-socket-dir-parent\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825753 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-kubelet\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-hostroot\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825807 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4448a632-9359-4650-9c0f-4778b59e235c-cni-binary-copy\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-multus-certs\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825837 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-modprobe-d\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825894 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-systemd\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825898 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-hostroot\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825957 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-os-release\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825982 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-socket-dir-parent\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825993 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a26ab917-2327-4c6d-ba63-f3310f7e9347-iptables-alerter-script\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825999 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-multus-certs\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.825985 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-run-k8s-cni-cncf-io\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-etc-kubernetes\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d75b25e5-477e-4784-956b-672905da91a3-kubelet-config\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826105 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-systemd-units\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826105 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-etc-kubernetes\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.826122 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-conf-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.828421 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826169 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d75b25e5-477e-4784-956b-672905da91a3-kubelet-config\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826216 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-device-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826268 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-cnibin\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826297 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-multus-conf-dir\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826304 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.826358 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret podName:d75b25e5-477e-4784-956b-672905da91a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:01.326336478 +0000 UTC m=+2.990314462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret") pod "global-pull-secret-syncer-b8mns" (UID: "d75b25e5-477e-4784-956b-672905da91a3") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-lib-modules\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d17ec1a-0b7b-4180-85a6-a8d521015c38-tmp\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-cni-bin\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826616 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826584 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-lib-modules\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nvw6\" (UniqueName: \"kubernetes.io/projected/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-kube-api-access-4nvw6\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdvws\" (UniqueName: \"kubernetes.io/projected/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-kube-api-access-pdvws\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826772 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-cni-bin\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826816 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4448a632-9359-4650-9c0f-4778b59e235c-host-var-lib-kubelet\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.829487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysctl-d\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4448a632-9359-4650-9c0f-4778b59e235c-multus-daemon-config\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.826969 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-host\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mh2w\" (UniqueName: \"kubernetes.io/projected/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-kube-api-access-2mh2w\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-run-netns\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827137 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-sysctl-d\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827167 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-var-lib-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827196 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-host\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827193 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-host\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827245 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d17ec1a-0b7b-4180-85a6-a8d521015c38-host\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6r4f\" (UniqueName: \"kubernetes.io/projected/ca182ea3-4769-4e84-9ff7-121474b20948-kube-api-access-b6r4f\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827326 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-host-run-netns\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827390 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4448a632-9359-4650-9c0f-4778b59e235c-multus-daemon-config\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827397 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f2549e0-1b4c-4075-895a-307dfb86bf78-agent-certs\") pod \"konnectivity-agent-2q8nf\" (UID: \"1f2549e0-1b4c-4075-895a-307dfb86bf78\") " pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827490 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-var-lib-openvswitch\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827604 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brfcd\" (UniqueName: \"kubernetes.io/projected/4448a632-9359-4650-9c0f-4778b59e235c-kube-api-access-brfcd\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.830326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.827635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-serviceca\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.831124 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.828120 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-serviceca\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.831124 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.830262 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d17ec1a-0b7b-4180-85a6-a8d521015c38-tmp\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.831124 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.830283 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d17ec1a-0b7b-4180-85a6-a8d521015c38-etc-tuned\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.831267 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.831133 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.831267 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.831180 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f2549e0-1b4c-4075-895a-307dfb86bf78-agent-certs\") pod \"konnectivity-agent-2q8nf\" (UID: \"1f2549e0-1b4c-4075-895a-307dfb86bf78\") " pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:00.833479 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.833426 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwjv\" (UniqueName: \"kubernetes.io/projected/4d17ec1a-0b7b-4180-85a6-a8d521015c38-kube-api-access-dmwjv\") pod \"tuned-2gj6b\" (UID: \"4d17ec1a-0b7b-4180-85a6-a8d521015c38\") " pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:00.834107 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.834086 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkscv\" (UniqueName: \"kubernetes.io/projected/a26ab917-2327-4c6d-ba63-f3310f7e9347-kube-api-access-tkscv\") pod \"iptables-alerter-8wdmt\" (UID: \"a26ab917-2327-4c6d-ba63-f3310f7e9347\") " pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:00.840807 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.838011 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:00.840807 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.838054 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:00.840807 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.838071 2558 projected.go:196] Error preparing data for projected volume kube-api-access-mw8hl for pod openshift-network-diagnostics/network-check-target-8vf2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:00.840807 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.838622 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl podName:87a60940-9b1c-499b-85b4-31c44493cc32 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:01.338589116 +0000 UTC m=+3.002567110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mw8hl" (UniqueName: "kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl") pod "network-check-target-8vf2s" (UID: "87a60940-9b1c-499b-85b4-31c44493cc32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:00.842446 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.842088 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nvw6\" (UniqueName: \"kubernetes.io/projected/fbf5a98c-f4cc-47fa-9182-4227d1d531c6-kube-api-access-4nvw6\") pod \"ovnkube-node-t4vmm\" (UID: \"fbf5a98c-f4cc-47fa-9182-4227d1d531c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:00.842446 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.842392 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mh2w\" (UniqueName: \"kubernetes.io/projected/86e539ab-26b7-4771-acfb-8dfa0bbde7b9-kube-api-access-2mh2w\") pod \"node-ca-76s8v\" (UID: \"86e539ab-26b7-4771-acfb-8dfa0bbde7b9\") " pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:00.844642 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.844624 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brfcd\" (UniqueName: \"kubernetes.io/projected/4448a632-9359-4650-9c0f-4778b59e235c-kube-api-access-brfcd\") pod \"multus-wlk4t\" (UID: \"4448a632-9359-4650-9c0f-4778b59e235c\") " pod="openshift-multus/multus-wlk4t" Jul 28 00:01:00.928185 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-system-cni-dir\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.928320 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.928320 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928234 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-device-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.928320 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-cnibin\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.928320 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928257 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-system-cni-dir\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.928320 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdvws\" (UniqueName: \"kubernetes.io/projected/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-kube-api-access-pdvws\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928325 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928336 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928336 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-device-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928368 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-cnibin\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6r4f\" (UniqueName: \"kubernetes.io/projected/ca182ea3-4769-4e84-9ff7-121474b20948-kube-api-access-b6r4f\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.928416 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-hosts-file\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:00.928471 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:01.428453301 +0000 UTC m=+3.092431295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-sys-fs\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928534 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-hosts-file\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928574 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-socket-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928589 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-sys-fs\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-tmp-dir\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.928650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928628 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928656 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztv75\" (UniqueName: \"kubernetes.io/projected/18c495b6-909a-464c-818e-4dfd46285873-kube-api-access-ztv75\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928735 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-socket-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-os-release\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928784 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbwm6\" (UniqueName: \"kubernetes.io/projected/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-kube-api-access-lbwm6\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-registration-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928847 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-etc-selinux\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928874 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-os-release\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928895 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18c495b6-909a-464c-818e-4dfd46285873-registration-dir\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.928954 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-tmp-dir\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.929145 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.929270 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.929408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.929344 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca182ea3-4769-4e84-9ff7-121474b20948-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.929900 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.929440 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca182ea3-4769-4e84-9ff7-121474b20948-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.939155 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.939109 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdvws\" (UniqueName: \"kubernetes.io/projected/d53ee3dc-2347-4ca8-b291-8cc159b35b3a-kube-api-access-pdvws\") pod \"node-resolver-zrkn7\" (UID: \"d53ee3dc-2347-4ca8-b291-8cc159b35b3a\") " pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:00.942141 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.942095 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztv75\" (UniqueName: \"kubernetes.io/projected/18c495b6-909a-464c-818e-4dfd46285873-kube-api-access-ztv75\") pod \"aws-ebs-csi-driver-node-lbgpp\" (UID: \"18c495b6-909a-464c-818e-4dfd46285873\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:00.942365 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.942348 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6r4f\" (UniqueName: \"kubernetes.io/projected/ca182ea3-4769-4e84-9ff7-121474b20948-kube-api-access-b6r4f\") pod \"multus-additional-cni-plugins-gz24k\" (UID: \"ca182ea3-4769-4e84-9ff7-121474b20948\") " pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:00.942446 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:00.942387 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbwm6\" (UniqueName: \"kubernetes.io/projected/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-kube-api-access-lbwm6\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:01.011491 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.011468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" Jul 28 00:01:01.021650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.021633 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wlk4t" Jul 28 00:01:01.037763 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.037744 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8wdmt" Jul 28 00:01:01.044755 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.044722 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:01.052548 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.052526 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-76s8v" Jul 28 00:01:01.060378 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.060358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:01.068193 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.068176 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" Jul 28 00:01:01.076109 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.076091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zrkn7" Jul 28 00:01:01.081759 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.081740 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gz24k" Jul 28 00:01:01.331575 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.331483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:01.331750 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:01.331657 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:01.331750 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:01.331743 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret podName:d75b25e5-477e-4784-956b-672905da91a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:02.331724165 +0000 UTC m=+3.995702148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret") pod "global-pull-secret-syncer-b8mns" (UID: "d75b25e5-477e-4784-956b-672905da91a3") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:01.432619 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.432586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:01.432619 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.432623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:01.432835 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:01.432795 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:01.432879 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:01.432847 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:02.432832425 +0000 UTC m=+4.096810403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:01.432948 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:01.432927 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:01.432993 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:01.432956 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:01.432993 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:01.432973 2558 projected.go:196] Error preparing data for projected volume kube-api-access-mw8hl for pod openshift-network-diagnostics/network-check-target-8vf2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:01.433081 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:01.433036 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl podName:87a60940-9b1c-499b-85b4-31c44493cc32 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:02.433018341 +0000 UTC m=+4.096996322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mw8hl" (UniqueName: "kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl") pod "network-check-target-8vf2s" (UID: "87a60940-9b1c-499b-85b4-31c44493cc32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:01.756679 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.756571 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 23:56:00 +0000 UTC" deadline="2028-04-25 17:13:23.238805918 +0000 UTC" Jul 28 00:01:01.756679 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:01.756620 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15305h12m21.48218859s" Jul 28 00:01:01.879381 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.879349 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e539ab_26b7_4771_acfb_8dfa0bbde7b9.slice/crio-a6afc77f5e9157a17a304964fcd1ae57706e9b93a5269579fdb0295f67b8100a WatchSource:0}: Error finding container a6afc77f5e9157a17a304964fcd1ae57706e9b93a5269579fdb0295f67b8100a: Status 404 returned error can't find the container with id a6afc77f5e9157a17a304964fcd1ae57706e9b93a5269579fdb0295f67b8100a Jul 28 00:01:01.882068 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.882040 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53ee3dc_2347_4ca8_b291_8cc159b35b3a.slice/crio-8ef9ec26ea295931752403a871c47294ae98a875dd7e5097d115bec5328f6436 WatchSource:0}: Error finding container 8ef9ec26ea295931752403a871c47294ae98a875dd7e5097d115bec5328f6436: Status 404 returned error can't find the container with id 8ef9ec26ea295931752403a871c47294ae98a875dd7e5097d115bec5328f6436 Jul 28 00:01:01.884865 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.884837 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf5a98c_f4cc_47fa_9182_4227d1d531c6.slice/crio-9cd66fb8f819109e3c450456e9baa43312c8fecbfe4769331d8c1afdbeb68a51 WatchSource:0}: Error finding container 9cd66fb8f819109e3c450456e9baa43312c8fecbfe4769331d8c1afdbeb68a51: Status 404 returned error can't find the container with id 9cd66fb8f819109e3c450456e9baa43312c8fecbfe4769331d8c1afdbeb68a51 Jul 28 00:01:01.886605 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.886580 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26ab917_2327_4c6d_ba63_f3310f7e9347.slice/crio-7a45ae20dc6386fec89352b7c14019b7072c5e554fe6eecbc10cef915bb3cbf8 WatchSource:0}: Error finding container 7a45ae20dc6386fec89352b7c14019b7072c5e554fe6eecbc10cef915bb3cbf8: Status 404 returned error can't find the container with id 7a45ae20dc6386fec89352b7c14019b7072c5e554fe6eecbc10cef915bb3cbf8 Jul 28 00:01:01.887768 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.887357 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4448a632_9359_4650_9c0f_4778b59e235c.slice/crio-45a8b15183074a3471c7df7b5ec0f9afb2c3999dc75e2aa8836800c21b52e8b3 WatchSource:0}: Error finding container 45a8b15183074a3471c7df7b5ec0f9afb2c3999dc75e2aa8836800c21b52e8b3: Status 404 returned error can't find the container with id 45a8b15183074a3471c7df7b5ec0f9afb2c3999dc75e2aa8836800c21b52e8b3 Jul 28 00:01:01.888420 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.888387 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2549e0_1b4c_4075_895a_307dfb86bf78.slice/crio-a62e24f0ca359243ed37c78b3c64a77fd2dbcbda334b2bedae71920668cce161 WatchSource:0}: Error finding container a62e24f0ca359243ed37c78b3c64a77fd2dbcbda334b2bedae71920668cce161: Status 404 returned error can't find the container with id a62e24f0ca359243ed37c78b3c64a77fd2dbcbda334b2bedae71920668cce161 Jul 28 00:01:01.891215 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.891190 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c495b6_909a_464c_818e_4dfd46285873.slice/crio-dc339d6b5a24a7ba1c31f85821394a0b180bebc5da3ea8159b845b3d58e4cffc WatchSource:0}: Error finding container dc339d6b5a24a7ba1c31f85821394a0b180bebc5da3ea8159b845b3d58e4cffc: Status 404 returned error can't find the container with id dc339d6b5a24a7ba1c31f85821394a0b180bebc5da3ea8159b845b3d58e4cffc Jul 28 00:01:01.891926 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.891885 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d17ec1a_0b7b_4180_85a6_a8d521015c38.slice/crio-cf0c26a532b1e5111660ed889578e0de0acf417db49c1747516422ba26eb8090 WatchSource:0}: Error finding container cf0c26a532b1e5111660ed889578e0de0acf417db49c1747516422ba26eb8090: Status 404 returned error can't find the container with id cf0c26a532b1e5111660ed889578e0de0acf417db49c1747516422ba26eb8090 Jul 28 00:01:01.893122 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:01.893086 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca182ea3_4769_4e84_9ff7_121474b20948.slice/crio-5e5e1fc4312367dd808cde3fdb483cb3ab6f87b023e840e0e781d24889a00c0b WatchSource:0}: Error finding container 5e5e1fc4312367dd808cde3fdb483cb3ab6f87b023e840e0e781d24889a00c0b: Status 404 returned error can't find the container with id 5e5e1fc4312367dd808cde3fdb483cb3ab6f87b023e840e0e781d24889a00c0b Jul 28 00:01:02.339769 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.339449 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:02.339769 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.339622 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:02.339968 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.339820 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret podName:d75b25e5-477e-4784-956b-672905da91a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:04.33979869 +0000 UTC m=+6.003776672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret") pod "global-pull-secret-syncer-b8mns" (UID: "d75b25e5-477e-4784-956b-672905da91a3") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:02.411625 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.411322 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:02.441468 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.440643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:02.441468 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.440704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:02.441468 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.440854 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:02.441468 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.440912 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:04.440892323 +0000 UTC m=+6.104870305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:02.441468 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.441342 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:02.441468 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.441367 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:02.441468 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.441380 2558 projected.go:196] Error preparing data for projected volume kube-api-access-mw8hl for pod openshift-network-diagnostics/network-check-target-8vf2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:02.441468 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.441430 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl podName:87a60940-9b1c-499b-85b4-31c44493cc32 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:04.441412806 +0000 UTC m=+6.105390787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mw8hl" (UniqueName: "kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl") pod "network-check-target-8vf2s" (UID: "87a60940-9b1c-499b-85b4-31c44493cc32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:02.863032 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.862354 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:02.863032 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.862501 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:02.863032 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.862957 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:02.863682 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.863054 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:02.863682 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.863202 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:02.863682 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:02.863286 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:02.884875 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.884816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2q8nf" event={"ID":"1f2549e0-1b4c-4075-895a-307dfb86bf78","Type":"ContainerStarted","Data":"a62e24f0ca359243ed37c78b3c64a77fd2dbcbda334b2bedae71920668cce161"} Jul 28 00:01:02.890539 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.890479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wlk4t" event={"ID":"4448a632-9359-4650-9c0f-4778b59e235c","Type":"ContainerStarted","Data":"45a8b15183074a3471c7df7b5ec0f9afb2c3999dc75e2aa8836800c21b52e8b3"} Jul 28 00:01:02.895195 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.895137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8wdmt" event={"ID":"a26ab917-2327-4c6d-ba63-f3310f7e9347","Type":"ContainerStarted","Data":"7a45ae20dc6386fec89352b7c14019b7072c5e554fe6eecbc10cef915bb3cbf8"} Jul 28 00:01:02.904376 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.904342 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-76s8v" event={"ID":"86e539ab-26b7-4771-acfb-8dfa0bbde7b9","Type":"ContainerStarted","Data":"a6afc77f5e9157a17a304964fcd1ae57706e9b93a5269579fdb0295f67b8100a"} Jul 28 00:01:02.917804 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.917778 2558 generic.go:356] "Generic (PLEG): container finished" podID="cb13ac6284e244a084caf6e618d9237e" containerID="7dbb741f90de2761ecce4f8fdf51aa27659b9f2ad71e8a5d7f3df0a4d458a027" exitCode=0 Jul 28 00:01:02.917918 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.917860 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" event={"ID":"cb13ac6284e244a084caf6e618d9237e","Type":"ContainerDied","Data":"7dbb741f90de2761ecce4f8fdf51aa27659b9f2ad71e8a5d7f3df0a4d458a027"} Jul 28 00:01:02.950405 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.950372 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerStarted","Data":"5e5e1fc4312367dd808cde3fdb483cb3ab6f87b023e840e0e781d24889a00c0b"} Jul 28 00:01:02.966527 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.965916 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" event={"ID":"18c495b6-909a-464c-818e-4dfd46285873","Type":"ContainerStarted","Data":"dc339d6b5a24a7ba1c31f85821394a0b180bebc5da3ea8159b845b3d58e4cffc"} Jul 28 00:01:02.978267 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.978241 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"9cd66fb8f819109e3c450456e9baa43312c8fecbfe4769331d8c1afdbeb68a51"} Jul 28 00:01:02.986122 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.986094 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zrkn7" event={"ID":"d53ee3dc-2347-4ca8-b291-8cc159b35b3a","Type":"ContainerStarted","Data":"8ef9ec26ea295931752403a871c47294ae98a875dd7e5097d115bec5328f6436"} Jul 28 00:01:02.990320 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.990294 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" event={"ID":"82e831ea1e0a8337ebcffdb7c227d0e6","Type":"ContainerStarted","Data":"d942e5a0edbd44551fc804e675a19cb1fcb1e444425d96c5fd7e5c4ef4592c6c"} Jul 28 00:01:02.996051 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:02.996028 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" event={"ID":"4d17ec1a-0b7b-4180-85a6-a8d521015c38","Type":"ContainerStarted","Data":"cf0c26a532b1e5111660ed889578e0de0acf417db49c1747516422ba26eb8090"} Jul 28 00:01:04.010837 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.010802 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" event={"ID":"cb13ac6284e244a084caf6e618d9237e","Type":"ContainerStarted","Data":"185920501d745ef3e156aad21cd50110af9127276b0de54c749d12d9053faf2c"} Jul 28 00:01:04.027316 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.027254 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-17.ec2.internal" podStartSLOduration=4.027233106 podStartE2EDuration="4.027233106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:03.006534863 +0000 UTC m=+4.670512865" watchObservedRunningTime="2026-07-28 00:01:04.027233106 +0000 UTC m=+5.691211110" Jul 28 00:01:04.027625 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.027587 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-17.ec2.internal" podStartSLOduration=4.027569985 podStartE2EDuration="4.027569985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:04.026913449 +0000 UTC m=+5.690891452" watchObservedRunningTime="2026-07-28 00:01:04.027569985 +0000 UTC m=+5.691547988" Jul 28 00:01:04.356353 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.356261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:04.356520 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.356458 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:04.356596 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.356523 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret podName:d75b25e5-477e-4784-956b-672905da91a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:08.356503197 +0000 UTC m=+10.020481181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret") pod "global-pull-secret-syncer-b8mns" (UID: "d75b25e5-477e-4784-956b-672905da91a3") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:04.457289 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.457252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:04.457476 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.457359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:04.457874 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.457846 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:04.457975 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.457883 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:04.457975 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.457901 2558 projected.go:196] Error preparing data for projected volume kube-api-access-mw8hl for pod openshift-network-diagnostics/network-check-target-8vf2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:04.458091 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.457990 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl podName:87a60940-9b1c-499b-85b4-31c44493cc32 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:08.457967616 +0000 UTC m=+10.121945619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mw8hl" (UniqueName: "kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl") pod "network-check-target-8vf2s" (UID: "87a60940-9b1c-499b-85b4-31c44493cc32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:04.465908 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.465882 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:04.466031 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.465962 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:08.465942375 +0000 UTC m=+10.129920372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:04.861849 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.861820 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:04.862026 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.861831 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:04.862026 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.861950 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:04.862176 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.862024 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:04.862232 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:04.862179 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:04.862290 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:04.862274 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:06.862430 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:06.862400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:06.862883 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:06.862401 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:06.862883 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:06.862632 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:06.862883 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:06.862543 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:06.862883 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:06.862695 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:06.862883 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:06.862791 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:08.392791 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:08.392758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:08.393220 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.392951 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:08.393220 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.393022 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret podName:d75b25e5-477e-4784-956b-672905da91a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:16.393002354 +0000 UTC m=+18.056980347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret") pod "global-pull-secret-syncer-b8mns" (UID: "d75b25e5-477e-4784-956b-672905da91a3") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:08.493457 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:08.493336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:08.493457 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:08.493381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:08.493647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.493474 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:08.493647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.493494 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:08.493647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.493504 2558 projected.go:196] Error preparing data for projected volume kube-api-access-mw8hl for pod openshift-network-diagnostics/network-check-target-8vf2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:08.493647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.493527 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:08.493647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.493554 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl podName:87a60940-9b1c-499b-85b4-31c44493cc32 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:16.493539909 +0000 UTC m=+18.157517886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mw8hl" (UniqueName: "kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl") pod "network-check-target-8vf2s" (UID: "87a60940-9b1c-499b-85b4-31c44493cc32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:08.493647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.493582 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:16.493564863 +0000 UTC m=+18.157542850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:08.867583 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:08.864719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:08.867583 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.864904 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:08.867583 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:08.865374 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:08.867583 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.865504 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:08.867583 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:08.865576 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:08.867583 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:08.865752 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:10.861029 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:10.860989 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:10.861484 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:10.861003 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:10.861484 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:10.861111 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:10.861484 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:10.861162 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:10.861484 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:10.861213 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:10.861484 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:10.861289 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:12.861309 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:12.861278 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:12.861309 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:12.861296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:12.861798 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:12.861277 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:12.861798 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:12.861473 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:12.861798 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:12.861541 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:12.861798 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:12.861646 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:14.861136 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:14.861103 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:14.861544 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:14.861113 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:14.861544 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:14.861236 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:14.861544 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:14.861272 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:14.861544 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:14.861341 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:14.861544 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:14.861444 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:16.454585 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:16.454551 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:16.455070 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.454701 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:16.455070 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.454762 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret podName:d75b25e5-477e-4784-956b-672905da91a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:32.454744263 +0000 UTC m=+34.118722241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret") pod "global-pull-secret-syncer-b8mns" (UID: "d75b25e5-477e-4784-956b-672905da91a3") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:16.555384 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:16.555352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:16.555384 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:16.555385 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:16.555591 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.555492 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:16.555591 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.555511 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:16.555591 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.555533 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:16.555591 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.555545 2558 projected.go:196] Error preparing data for projected volume kube-api-access-mw8hl for pod openshift-network-diagnostics/network-check-target-8vf2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:16.555591 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.555554 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:32.555536959 +0000 UTC m=+34.219514951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:16.555591 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.555580 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl podName:87a60940-9b1c-499b-85b4-31c44493cc32 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:32.555569569 +0000 UTC m=+34.219547545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mw8hl" (UniqueName: "kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl") pod "network-check-target-8vf2s" (UID: "87a60940-9b1c-499b-85b4-31c44493cc32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:16.861522 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:16.861453 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:16.861522 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:16.861483 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:16.861756 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:16.861453 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:16.861756 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.861569 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:16.861756 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.861647 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:16.861756 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:16.861739 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:18.861565 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:18.861536 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:18.862003 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:18.861612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:18.862003 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:18.861627 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:18.862003 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:18.861735 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:18.862003 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:18.861803 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:18.862003 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:18.861875 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:20.861299 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:20.860951 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:20.862061 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:20.860951 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:20.862061 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:20.861391 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:20.862061 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:20.860964 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:20.862061 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:20.861431 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:20.862061 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:20.861538 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:21.043271 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.043194 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" event={"ID":"4d17ec1a-0b7b-4180-85a6-a8d521015c38","Type":"ContainerStarted","Data":"c988444f9cbd7affea2eab22c8e122a61b574521a2bd43a621dfa5b818f63377"} Jul 28 00:01:21.044726 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.044702 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2q8nf" event={"ID":"1f2549e0-1b4c-4075-895a-307dfb86bf78","Type":"ContainerStarted","Data":"cb042660c0bf3211076d4121cfa63a528f7325b8bc4d3a1f5a287abd0eaf0c8d"} Jul 28 00:01:21.046231 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.046210 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wlk4t" event={"ID":"4448a632-9359-4650-9c0f-4778b59e235c","Type":"ContainerStarted","Data":"5bbf149b38078b1a47dfdf326c55764d7d2fd8500bcc39797964b4c9ff7b16c0"} Jul 28 00:01:21.047770 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.047747 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-76s8v" event={"ID":"86e539ab-26b7-4771-acfb-8dfa0bbde7b9","Type":"ContainerStarted","Data":"d13bb1ca7fa8af1e499815075d8fed42d264716d0cf0576af8a900dd3c3f7471"} Jul 28 00:01:21.049452 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.049428 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca182ea3-4769-4e84-9ff7-121474b20948" containerID="7f6d5ea6dc5db97f4d6f0f6ec09fc0f94536e68ce1c7f3e1a9358fa9ee645e11" exitCode=0 Jul 28 00:01:21.049542 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.049512 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerDied","Data":"7f6d5ea6dc5db97f4d6f0f6ec09fc0f94536e68ce1c7f3e1a9358fa9ee645e11"} Jul 28 00:01:21.051088 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.051065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" event={"ID":"18c495b6-909a-464c-818e-4dfd46285873","Type":"ContainerStarted","Data":"8d67fd2f8a7b3fd8214349c952d9c1d4ad869fa67837aa5188e627906ddce932"} Jul 28 00:01:21.054525 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.054501 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"c84fa2c8f127e54d928a61db922bb2f9e9c48005929aa90cedeb6155e0300f05"} Jul 28 00:01:21.054615 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.054561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"06bd926ab2b164cad5283f8f031b08d850b7595de2e74e53c6c11b1bf500efd3"} Jul 28 00:01:21.054615 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.054600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"513d23f50829636d4384fab82aacc365f3d483747641a5f6332a7aed309a6455"} Jul 28 00:01:21.054718 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.054631 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"5a42efcd3e618714524a37f29ed63f5f18e475a7344253b2916cc6a0442e5b02"} Jul 28 00:01:21.054718 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.054676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"b975909aac23ddab1511313b36b56a967650325f3fbdb5752f487d5b9312fda7"} Jul 28 00:01:21.054718 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.054709 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"82b1bd64edd83151d5fb5959db953bf5fedae5806a04ded79e349f33780cd4b0"} Jul 28 00:01:21.056128 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.056108 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zrkn7" event={"ID":"d53ee3dc-2347-4ca8-b291-8cc159b35b3a","Type":"ContainerStarted","Data":"01339ad1ac0204fab4d1320bac58d865fb8a66b540157854a7bdbb7af6f04698"} Jul 28 00:01:21.060161 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.060127 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2gj6b" podStartSLOduration=3.908730447 podStartE2EDuration="22.060114702s" totalImagesPullingTime="18.151384255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:21.05950166 +0000 UTC m=+22.723479658" watchObservedRunningTime="2026-07-28 00:01:21.060114702 +0000 UTC m=+22.724092700" Jul 28 00:01:21.072490 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.072449 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-76s8v" podStartSLOduration=3.909507453 podStartE2EDuration="22.072435959s" totalImagesPullingTime="18.162928506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:21.072067848 +0000 UTC m=+22.736045849" watchObservedRunningTime="2026-07-28 00:01:21.072435959 +0000 UTC m=+22.736413956" Jul 28 00:01:21.122747 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.122709 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zrkn7" podStartSLOduration=3.962489936 podStartE2EDuration="22.122698003s" totalImagesPullingTime="18.160208067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:21.122446463 +0000 UTC m=+22.786424462" watchObservedRunningTime="2026-07-28 00:01:21.122698003 +0000 UTC m=+22.786676000" Jul 28 00:01:21.123014 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.122969 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2q8nf" podStartSLOduration=11.827926899 podStartE2EDuration="22.122963584s" totalImagesPullingTime="10.295036685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:21.100972249 +0000 UTC m=+22.764950250" watchObservedRunningTime="2026-07-28 00:01:21.122963584 +0000 UTC m=+22.786941618" Jul 28 00:01:21.142094 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.142062 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wlk4t" podStartSLOduration=3.978965907 podStartE2EDuration="22.142052104s" totalImagesPullingTime="18.163086197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:21.142033082 +0000 UTC m=+22.806011079" watchObservedRunningTime="2026-07-28 00:01:21.142052104 +0000 UTC m=+22.806030105" Jul 28 00:01:21.592107 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.592081 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 00:01:21.784307 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.784143 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T00:01:21.592102717Z","UUID":"ed70837e-895c-4f64-ac68-d34dd23d83af","Handler":null,"Name":"","Endpoint":""} Jul 28 00:01:21.786486 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.786466 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 00:01:21.786584 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:21.786504 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 00:01:22.059746 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:22.059652 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8wdmt" event={"ID":"a26ab917-2327-4c6d-ba63-f3310f7e9347","Type":"ContainerStarted","Data":"4d6b64e30f302befced8d71bb7d3b4fd6dcc07b5b4f0d2b61d0a8d0e9746c3ed"} Jul 28 00:01:22.061708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:22.061677 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" event={"ID":"18c495b6-909a-464c-818e-4dfd46285873","Type":"ContainerStarted","Data":"ba14ad4d7d6c8e04536393a470ef182f3bbbc34c4727dd82489de4f2b04ec765"} Jul 28 00:01:22.073428 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:22.073378 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8wdmt" podStartSLOduration=4.918362716 podStartE2EDuration="23.073360127s" totalImagesPullingTime="18.154997411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:22.072747046 +0000 UTC m=+23.736725045" watchObservedRunningTime="2026-07-28 00:01:22.073360127 +0000 UTC m=+23.737338126" Jul 28 00:01:22.646045 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:22.646014 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:22.646762 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:22.646730 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:22.861500 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:22.861474 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:22.861681 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:22.861474 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:22.861749 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:22.861702 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:22.861873 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:22.861839 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:22.861975 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:22.861938 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:22.862082 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:22.862031 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:23.066363 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:23.066322 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" event={"ID":"18c495b6-909a-464c-818e-4dfd46285873","Type":"ContainerStarted","Data":"4a40d3c88a3c3e312c012e2e0bb61256bbe7beffa8f659f6a2628ec044e50004"} Jul 28 00:01:23.071269 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:23.071241 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"c0f9d8953dfecad24d3113d44fb5ce231e517eb27b9a31b4a962d874745e55a4"} Jul 28 00:01:23.082764 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:23.082422 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lbgpp" podStartSLOduration=3.373340595 podStartE2EDuration="24.082403333s" totalImagesPullingTime="20.709062738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:23.08151901 +0000 UTC m=+24.745497008" watchObservedRunningTime="2026-07-28 00:01:23.082403333 +0000 UTC m=+24.746381529" Jul 28 00:01:24.074035 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:24.073834 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 00:01:24.861090 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:24.861057 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:24.861294 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:24.861063 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:24.861294 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:24.861179 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:24.861294 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:24.861177 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:24.861294 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:24.861278 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:24.861471 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:24.861325 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:25.014420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:25.014386 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:25.015231 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:25.015210 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2q8nf" Jul 28 00:01:26.079504 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:26.079298 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca182ea3-4769-4e84-9ff7-121474b20948" containerID="3cd38707712fd1e5f7cac39dd356fb4afa7b31150d5340a59e70ee46e95de87c" exitCode=0 Jul 28 00:01:26.080377 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:26.079344 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerDied","Data":"3cd38707712fd1e5f7cac39dd356fb4afa7b31150d5340a59e70ee46e95de87c"} Jul 28 00:01:26.083866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:26.083841 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" event={"ID":"fbf5a98c-f4cc-47fa-9182-4227d1d531c6","Type":"ContainerStarted","Data":"f1de01b292a775479b786bcdc1eff2c0804aca7c6071219bd4c31af9558df876"} Jul 28 00:01:26.125938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:26.125898 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" podStartSLOduration=8.779654096 podStartE2EDuration="27.125885451s" totalImagesPullingTime="18.346231355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:26.12478355 +0000 UTC m=+27.788761547" watchObservedRunningTime="2026-07-28 00:01:26.125885451 +0000 UTC m=+27.789863449" Jul 28 00:01:26.861273 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:26.861248 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:26.861453 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:26.861282 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:26.861453 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:26.861247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:26.861453 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:26.861354 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:26.861545 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:26.861444 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:26.861545 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:26.861516 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:27.086028 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.085963 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 00:01:27.086524 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.086487 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:27.086606 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.086570 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:27.103319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.103246 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:27.103584 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.103569 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:27.339507 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.339478 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vf2s"] Jul 28 00:01:27.339617 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.339583 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:27.339721 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:27.339699 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:27.342594 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.342560 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8mns"] Jul 28 00:01:27.342720 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.342641 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:27.342776 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:27.342757 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:27.343141 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.343120 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtwj5"] Jul 28 00:01:27.343226 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:27.343201 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:27.343312 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:27.343293 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:28.092213 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:28.092174 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca182ea3-4769-4e84-9ff7-121474b20948" containerID="e4f2d11ccd6915862888891033a809dbd6f04e2e8bd7d40bf8b16b5bfc043b33" exitCode=0 Jul 28 00:01:28.092633 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:28.092252 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerDied","Data":"e4f2d11ccd6915862888891033a809dbd6f04e2e8bd7d40bf8b16b5bfc043b33"} Jul 28 00:01:28.092633 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:28.092360 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 00:01:28.861435 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:28.861407 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:28.861594 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:28.861507 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:28.861594 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:28.861542 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:28.861594 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:28.861557 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:28.861753 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:28.861624 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:28.861753 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:28.861728 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:29.094167 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:29.094144 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 00:01:29.520972 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:29.520951 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:01:30.099599 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:30.099325 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca182ea3-4769-4e84-9ff7-121474b20948" containerID="4f1a61d43e30bc548e47e977f8b7acd17acc192fb0d85da7c54568ead06fee05" exitCode=0 Jul 28 00:01:30.099962 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:30.099408 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerDied","Data":"4f1a61d43e30bc548e47e977f8b7acd17acc192fb0d85da7c54568ead06fee05"} Jul 28 00:01:30.121545 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:30.121505 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" podUID="fbf5a98c-f4cc-47fa-9182-4227d1d531c6" containerName="ovnkube-controller" probeResult="failure" output="" Jul 28 00:01:30.861480 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:30.861419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:30.861644 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:30.861535 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:30.861644 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:30.861422 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:30.861753 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:30.861697 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:30.861753 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:30.861561 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:30.861830 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:30.861779 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:32.474546 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:32.474515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:32.474907 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.474683 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:32.474907 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.474743 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret podName:d75b25e5-477e-4784-956b-672905da91a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:04.474727836 +0000 UTC m=+66.138705815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret") pod "global-pull-secret-syncer-b8mns" (UID: "d75b25e5-477e-4784-956b-672905da91a3") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:32.574891 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:32.574859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:32.574891 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:32.574893 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:32.575108 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.575019 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:32.575108 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.575024 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:32.575108 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.575040 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:32.575108 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.575053 2558 projected.go:196] Error preparing data for projected volume kube-api-access-mw8hl for pod openshift-network-diagnostics/network-check-target-8vf2s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:32.575108 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.575079 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:04.575060979 +0000 UTC m=+66.239038959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:32.575108 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.575094 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl podName:87a60940-9b1c-499b-85b4-31c44493cc32 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:04.575086728 +0000 UTC m=+66.239064711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mw8hl" (UniqueName: "kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl") pod "network-check-target-8vf2s" (UID: "87a60940-9b1c-499b-85b4-31c44493cc32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:32.864353 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:32.864273 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:32.864511 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:32.864284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:32.864511 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.864387 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8mns" podUID="d75b25e5-477e-4784-956b-672905da91a3" Jul 28 00:01:32.864511 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:32.864280 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:32.864511 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.864464 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vf2s" podUID="87a60940-9b1c-499b-85b4-31c44493cc32" Jul 28 00:01:32.864729 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:32.864537 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:01:33.649014 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.648982 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-17.ec2.internal" event="NodeReady" Jul 28 00:01:33.649510 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.649109 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 00:01:33.686792 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.686045 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77ddbd6f55-95nmj"] Jul 28 00:01:33.688535 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.688511 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.689724 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.689701 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29753280-pswrj"] Jul 28 00:01:33.690574 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.690547 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g2k9m\"" Jul 28 00:01:33.690712 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.690678 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 00:01:33.690909 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.690889 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 00:01:33.691006 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.690957 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 00:01:33.691837 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.691819 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6"] Jul 28 00:01:33.692041 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.691995 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:01:33.693902 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.693884 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-pdx68"] Jul 28 00:01:33.694084 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.693997 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6" Jul 28 00:01:33.695997 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.695979 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 00:01:33.696078 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.696026 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:33.698882 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.698842 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 00:01:33.699001 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.698985 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Jul 28 00:01:33.699353 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.699338 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hfm8c\"" Jul 28 00:01:33.699470 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.699454 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 00:01:33.699814 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.699800 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 00:01:33.699947 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.699928 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-lkcgm\"" Jul 28 00:01:33.700008 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.699948 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 00:01:33.700059 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.700032 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g4g2s\"" Jul 28 00:01:33.706319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.706299 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29753280-pswrj"] Jul 28 00:01:33.708441 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.707225 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77ddbd6f55-95nmj"] Jul 28 00:01:33.708441 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.708018 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-pdx68"] Jul 28 00:01:33.711220 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.711012 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-htw4s"] Jul 28 00:01:33.713905 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.713379 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k95mb"] Jul 28 00:01:33.713905 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.713527 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.715192 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.715127 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k95mb" Jul 28 00:01:33.715852 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.715826 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wxjjr\"" Jul 28 00:01:33.716176 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.716157 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 00:01:33.717319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.717195 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 00:01:33.717425 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.717406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 00:01:33.717490 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.717462 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 00:01:33.717733 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.717719 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ztr5f\"" Jul 28 00:01:33.718247 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.718231 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 00:01:33.727087 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.726247 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6"] Jul 28 00:01:33.729595 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.729526 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-htw4s"] Jul 28 00:01:33.730314 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.730295 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k95mb"] Jul 28 00:01:33.731148 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.731126 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:33.783868 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.783843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfx58\" (UniqueName: \"kubernetes.io/projected/d5164661-5fbb-4e7b-8c91-fd1b5038bd29-kube-api-access-nfx58\") pod \"network-check-source-7d88cb55d8-kk6w6\" (UID: \"d5164661-5fbb-4e7b-8c91-fd1b5038bd29\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6" Jul 28 00:01:33.783978 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.783875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn2st\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-kube-api-access-xn2st\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.783978 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.783895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:33.783978 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.783926 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-certificates\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.783978 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.783956 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff980859-8405-4c8d-a225-f5d65b0afcab-serviceca\") pod \"image-pruner-29753280-pswrj\" (UID: \"ff980859-8405-4c8d-a225-f5d65b0afcab\") " pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:01:33.784126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.784006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98kd6\" (UniqueName: \"kubernetes.io/projected/ff980859-8405-4c8d-a225-f5d65b0afcab-kube-api-access-98kd6\") pod \"image-pruner-29753280-pswrj\" (UID: \"ff980859-8405-4c8d-a225-f5d65b0afcab\") " pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:01:33.784126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.784044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-image-registry-private-configuration\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.784126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.784078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-trusted-ca\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.784126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.784111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-bound-sa-token\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.784274 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.784144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.784274 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.784169 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-installation-pull-secrets\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.784274 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.784197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-ca-trust-extracted\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.784274 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.784262 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7cf66491-1481-432c-9286-3e56a7efd5dd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:33.883828 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.883773 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:33.884742 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884723 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d-cert\") pod \"ingress-canary-k95mb\" (UID: \"dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d\") " pod="openshift-ingress-canary/ingress-canary-k95mb" Jul 28 00:01:33.884803 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqlzj\" (UniqueName: \"kubernetes.io/projected/dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d-kube-api-access-hqlzj\") pod \"ingress-canary-k95mb\" (UID: \"dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d\") " pod="openshift-ingress-canary/ingress-canary-k95mb" Jul 28 00:01:33.884844 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-bound-sa-token\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.884844 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.884900 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-installation-pull-secrets\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.884900 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-ca-trust-extracted\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.884900 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7cf66491-1481-432c-9286-3e56a7efd5dd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:33.885025 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfx58\" (UniqueName: \"kubernetes.io/projected/d5164661-5fbb-4e7b-8c91-fd1b5038bd29-kube-api-access-nfx58\") pod \"network-check-source-7d88cb55d8-kk6w6\" (UID: \"d5164661-5fbb-4e7b-8c91-fd1b5038bd29\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6" Jul 28 00:01:33.885025 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn2st\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-kube-api-access-xn2st\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.885025 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.884985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:33.885025 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:33.884937 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:33.885025 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885019 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-certificates\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885044 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff980859-8405-4c8d-a225-f5d65b0afcab-serviceca\") pod \"image-pruner-29753280-pswrj\" (UID: \"ff980859-8405-4c8d-a225-f5d65b0afcab\") " pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885072 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98kd6\" (UniqueName: \"kubernetes.io/projected/ff980859-8405-4c8d-a225-f5d65b0afcab-kube-api-access-98kd6\") pod \"image-pruner-29753280-pswrj\" (UID: \"ff980859-8405-4c8d-a225-f5d65b0afcab\") " pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885094 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3049a2d-6e5e-446b-b0d5-e18425a57881-config-volume\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3049a2d-6e5e-446b-b0d5-e18425a57881-tmp-dir\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:33.885022 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885153 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-image-registry-private-configuration\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncppw\" (UniqueName: \"kubernetes.io/projected/e3049a2d-6e5e-446b-b0d5-e18425a57881-kube-api-access-ncppw\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:33.885196 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:34.385179085 +0000 UTC m=+36.049157067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:01:33.885244 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:33.885119 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:01:33.885650 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:33.885331 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:01:34.385318392 +0000 UTC m=+36.049296374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:01:33.885650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885330 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-ca-trust-extracted\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.885650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-trusted-ca\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.885650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885612 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff980859-8405-4c8d-a225-f5d65b0afcab-serviceca\") pod \"image-pruner-29753280-pswrj\" (UID: \"ff980859-8405-4c8d-a225-f5d65b0afcab\") " pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:01:33.885650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.885650 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885613 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7cf66491-1481-432c-9286-3e56a7efd5dd-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:33.885936 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.885855 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-certificates\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.886338 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.886319 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-trusted-ca\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.888982 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.888960 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-image-registry-private-configuration\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.888982 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.888969 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-installation-pull-secrets\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.897500 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.897474 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-bound-sa-token\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.898456 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.898430 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfx58\" (UniqueName: \"kubernetes.io/projected/d5164661-5fbb-4e7b-8c91-fd1b5038bd29-kube-api-access-nfx58\") pod \"network-check-source-7d88cb55d8-kk6w6\" (UID: \"d5164661-5fbb-4e7b-8c91-fd1b5038bd29\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6" Jul 28 00:01:33.898721 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.898702 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn2st\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-kube-api-access-xn2st\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:33.898927 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.898909 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98kd6\" (UniqueName: \"kubernetes.io/projected/ff980859-8405-4c8d-a225-f5d65b0afcab-kube-api-access-98kd6\") pod \"image-pruner-29753280-pswrj\" (UID: \"ff980859-8405-4c8d-a225-f5d65b0afcab\") " pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:01:33.986458 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.986439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqlzj\" (UniqueName: \"kubernetes.io/projected/dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d-kube-api-access-hqlzj\") pod \"ingress-canary-k95mb\" (UID: \"dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d\") " pod="openshift-ingress-canary/ingress-canary-k95mb" Jul 28 00:01:33.986564 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.986507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3049a2d-6e5e-446b-b0d5-e18425a57881-config-volume\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.986564 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.986529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3049a2d-6e5e-446b-b0d5-e18425a57881-tmp-dir\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.986564 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.986559 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncppw\" (UniqueName: \"kubernetes.io/projected/e3049a2d-6e5e-446b-b0d5-e18425a57881-kube-api-access-ncppw\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.986730 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.986590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.986730 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:33.986656 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:33.986830 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:33.986730 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:34.486714393 +0000 UTC m=+36.150692370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:01:33.986830 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.986774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d-cert\") pod \"ingress-canary-k95mb\" (UID: \"dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d\") " pod="openshift-ingress-canary/ingress-canary-k95mb" Jul 28 00:01:33.986948 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.986913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3049a2d-6e5e-446b-b0d5-e18425a57881-tmp-dir\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.987089 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.987061 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3049a2d-6e5e-446b-b0d5-e18425a57881-config-volume\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:33.989023 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:33.988896 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d-cert\") pod \"ingress-canary-k95mb\" (UID: \"dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d\") " pod="openshift-ingress-canary/ingress-canary-k95mb" Jul 28 00:01:34.004437 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.004407 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqlzj\" (UniqueName: \"kubernetes.io/projected/dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d-kube-api-access-hqlzj\") pod \"ingress-canary-k95mb\" (UID: \"dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d\") " pod="openshift-ingress-canary/ingress-canary-k95mb" Jul 28 00:01:34.005155 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.005137 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncppw\" (UniqueName: \"kubernetes.io/projected/e3049a2d-6e5e-446b-b0d5-e18425a57881-kube-api-access-ncppw\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:34.010265 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.010241 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6" Jul 28 00:01:34.018233 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.018217 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:01:34.037834 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.037802 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k95mb" Jul 28 00:01:34.112342 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.112308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerStarted","Data":"ce610c7c83eb8268a38476054eb15acd7b96bd089acd3a27578bce81e354e7ac"} Jul 28 00:01:34.184261 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.184230 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6"] Jul 28 00:01:34.194525 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.194503 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29753280-pswrj"] Jul 28 00:01:34.215305 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.215224 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k95mb"] Jul 28 00:01:34.217916 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:34.217879 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff980859_8405_4c8d_a225_f5d65b0afcab.slice/crio-a7019e4f3721e6d648722f2c2eaaff9552b1e3f99553bb3b94fd8dfbadeacb91 WatchSource:0}: Error finding container a7019e4f3721e6d648722f2c2eaaff9552b1e3f99553bb3b94fd8dfbadeacb91: Status 404 returned error can't find the container with id a7019e4f3721e6d648722f2c2eaaff9552b1e3f99553bb3b94fd8dfbadeacb91 Jul 28 00:01:34.218653 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:34.218633 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec66b39_7e3c_4b1c_b4ed_ab609bc7aa3d.slice/crio-9aac0e0c9f0ffa7fdc805a09e26b2270fd3955337a0ae9f2370f4a648fabca0c WatchSource:0}: Error finding container 9aac0e0c9f0ffa7fdc805a09e26b2270fd3955337a0ae9f2370f4a648fabca0c: Status 404 returned error can't find the container with id 9aac0e0c9f0ffa7fdc805a09e26b2270fd3955337a0ae9f2370f4a648fabca0c Jul 28 00:01:34.219903 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:01:34.219881 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5164661_5fbb_4e7b_8c91_fd1b5038bd29.slice/crio-151b2119e33552c7bbc79873ac49c7636474094f24b9d16ccef0f95d6ba517f8 WatchSource:0}: Error finding container 151b2119e33552c7bbc79873ac49c7636474094f24b9d16ccef0f95d6ba517f8: Status 404 returned error can't find the container with id 151b2119e33552c7bbc79873ac49c7636474094f24b9d16ccef0f95d6ba517f8 Jul 28 00:01:34.393337 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.393265 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:34.393488 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.393346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:34.393488 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:34.393399 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:34.393488 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:34.393422 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:01:34.393488 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:34.393467 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:01:34.393637 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:34.393491 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:35.393471206 +0000 UTC m=+37.057449184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:01:34.393637 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:34.393512 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:01:35.393498247 +0000 UTC m=+37.057476240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:01:34.493639 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.493608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:34.493786 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:34.493758 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:34.493829 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:34.493808 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:35.493795377 +0000 UTC m=+37.157773354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:01:34.807636 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.807563 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:34.861031 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.860617 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:01:34.861031 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.860617 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:01:34.861031 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.860794 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:01:34.863290 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.863125 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:01:34.863744 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.863722 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:01:34.863964 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.863944 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8t2hm\"" Jul 28 00:01:34.864141 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.864126 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-shf5w\"" Jul 28 00:01:34.907652 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:34.907578 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:35.117096 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.117025 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29753280-pswrj" event={"ID":"ff980859-8405-4c8d-a225-f5d65b0afcab","Type":"ContainerStarted","Data":"930101425b6548339b8992fb1d10742ea290bad7f7ac1f33acce85e18204a9db"} Jul 28 00:01:35.117221 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.117116 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29753280-pswrj" event={"ID":"ff980859-8405-4c8d-a225-f5d65b0afcab","Type":"ContainerStarted","Data":"a7019e4f3721e6d648722f2c2eaaff9552b1e3f99553bb3b94fd8dfbadeacb91"} Jul 28 00:01:35.118404 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.118381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6" event={"ID":"d5164661-5fbb-4e7b-8c91-fd1b5038bd29","Type":"ContainerStarted","Data":"151b2119e33552c7bbc79873ac49c7636474094f24b9d16ccef0f95d6ba517f8"} Jul 28 00:01:35.122521 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.122491 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca182ea3-4769-4e84-9ff7-121474b20948" containerID="ce610c7c83eb8268a38476054eb15acd7b96bd089acd3a27578bce81e354e7ac" exitCode=0 Jul 28 00:01:35.123986 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.123052 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerDied","Data":"ce610c7c83eb8268a38476054eb15acd7b96bd089acd3a27578bce81e354e7ac"} Jul 28 00:01:35.126842 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.126768 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k95mb" event={"ID":"dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d","Type":"ContainerStarted","Data":"9aac0e0c9f0ffa7fdc805a09e26b2270fd3955337a0ae9f2370f4a648fabca0c"} Jul 28 00:01:35.133570 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.133469 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29753280-pswrj" podStartSLOduration=95.133451587 podStartE2EDuration="1m35.133451587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:35.132516114 +0000 UTC m=+36.796494124" watchObservedRunningTime="2026-07-28 00:01:35.133451587 +0000 UTC m=+36.797429586" Jul 28 00:01:35.402378 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.402297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:35.402378 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.402366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:35.402561 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:35.402441 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:35.402561 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:35.402457 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:01:35.402561 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:35.402513 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:37.40249462 +0000 UTC m=+39.066472602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:01:35.402561 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:35.402446 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:01:35.402736 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:35.402588 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:01:37.402567538 +0000 UTC m=+39.066545514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:01:35.503401 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:35.503365 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:35.503543 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:35.503512 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:35.503611 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:35.503578 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:37.503559424 +0000 UTC m=+39.167537420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:01:36.133840 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:36.133569 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca182ea3-4769-4e84-9ff7-121474b20948" containerID="b982ab09e66ac01c1196f3bdefc05c48ba779924b0868577868439fe9c7ae083" exitCode=0 Jul 28 00:01:36.134244 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:36.133896 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerDied","Data":"b982ab09e66ac01c1196f3bdefc05c48ba779924b0868577868439fe9c7ae083"} Jul 28 00:01:37.419763 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:37.419722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:37.420165 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:37.419794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:37.420165 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:37.419883 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:01:37.420165 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:37.419892 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:37.420165 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:37.419914 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:01:37.420165 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:37.419950 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:01:41.419937257 +0000 UTC m=+43.083915234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:01:37.420165 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:37.419963 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:41.419957505 +0000 UTC m=+43.083935481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:01:37.521163 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:37.521138 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:37.521313 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:37.521245 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:37.521313 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:37.521291 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:41.521279178 +0000 UTC m=+43.185257154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:01:38.141165 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:38.141087 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6" event={"ID":"d5164661-5fbb-4e7b-8c91-fd1b5038bd29","Type":"ContainerStarted","Data":"70dee9d5a9e82857c77cb0a1ab30e4c5e2563bf4d766e00266633d1153310d36"} Jul 28 00:01:38.145580 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:38.145144 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz24k" event={"ID":"ca182ea3-4769-4e84-9ff7-121474b20948","Type":"ContainerStarted","Data":"f549b3588d53a4c57280f5d9f7b00351723ccf7e35ffdee140ee280f9127f66a"} Jul 28 00:01:38.146613 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:38.146589 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k95mb" event={"ID":"dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d","Type":"ContainerStarted","Data":"b518675a9ce38f0ce154c5b791808379c5f7eb882ccb7c151058769938868dd6"} Jul 28 00:01:38.159963 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:38.159922 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-kk6w6" podStartSLOduration=31.551611659 podStartE2EDuration="35.159907566s" totalImagesPullingTime="3.608295907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:38.159794055 +0000 UTC m=+39.823772054" watchObservedRunningTime="2026-07-28 00:01:38.159907566 +0000 UTC m=+39.823885563" Jul 28 00:01:38.175803 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:38.175750 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k95mb" podStartSLOduration=1.5762658680000001 podStartE2EDuration="5.175732468s" totalImagesPullingTime="3.5994666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:38.174801388 +0000 UTC m=+39.838779407" watchObservedRunningTime="2026-07-28 00:01:38.175732468 +0000 UTC m=+39.839710467" Jul 28 00:01:38.200840 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:38.200464 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gz24k" podStartSLOduration=10.571777684 podStartE2EDuration="39.200445591s" totalImagesPullingTime="28.628667907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:38.199549589 +0000 UTC m=+39.863527589" watchObservedRunningTime="2026-07-28 00:01:38.200445591 +0000 UTC m=+39.864423588" Jul 28 00:01:38.322898 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:38.322865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:38.384725 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:38.384696 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:41.446416 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:41.446360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:41.447214 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:41.446423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:41.447214 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:41.446518 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:41.447214 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:41.446541 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:01:41.447214 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:41.446559 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:01:41.447214 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:41.446600 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:49.446584167 +0000 UTC m=+51.110562147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:01:41.447214 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:41.446619 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:01:49.446606669 +0000 UTC m=+51.110584645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:01:41.547262 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:41.547235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:41.547383 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:41.547364 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:41.547429 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:41.547418 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:49.547405789 +0000 UTC m=+51.211383766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:01:44.469381 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:44.469309 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:44.567202 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:44.567170 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:45.300019 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:45.299981 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:45.399547 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:45.399523 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:47.908341 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:47.908311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:47.967799 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:47.967767 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:48.644953 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:48.644922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:48.723520 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:48.723497 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:01:49.499191 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:49.499153 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:01:49.499647 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:49.499234 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:01:49.499647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:49.499298 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:01:49.499647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:49.499331 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:49.499647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:49.499345 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:01:49.499647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:49.499363 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:02:05.499348841 +0000 UTC m=+67.163326817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:01:49.499647 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:49.499417 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:05.499402159 +0000 UTC m=+67.163380135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:01:49.599998 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:01:49.599972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:01:49.600085 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:49.600073 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:49.600130 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:01:49.600124 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:05.60011387 +0000 UTC m=+67.264091847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:02:00.110410 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:00.110375 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t4vmm" Jul 28 00:02:00.264560 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:00.264521 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:00.322723 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:00.322692 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:04.507836 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.507797 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:02:04.510133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.510107 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:02:04.523605 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.523574 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d75b25e5-477e-4784-956b-672905da91a3-original-pull-secret\") pod \"global-pull-secret-syncer-b8mns\" (UID: \"d75b25e5-477e-4784-956b-672905da91a3\") " pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:02:04.581808 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.581785 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8mns" Jul 28 00:02:04.609132 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.609102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:02:04.609275 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.609143 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:02:04.611081 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.611060 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:02:04.611403 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.611383 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw8hl\" (UniqueName: \"kubernetes.io/projected/87a60940-9b1c-499b-85b4-31c44493cc32-kube-api-access-mw8hl\") pod \"network-check-target-8vf2s\" (UID: \"87a60940-9b1c-499b-85b4-31c44493cc32\") " pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:02:04.619786 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:04.619766 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 00:02:04.619901 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:04.619828 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:03:08.619807791 +0000 UTC m=+130.283785785 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : secret "metrics-daemon-secret" not found Jul 28 00:02:04.701820 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.701789 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8mns"] Jul 28 00:02:04.705539 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:02:04.705513 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75b25e5_477e_4784_956b_672905da91a3.slice/crio-6bec10959824c7622768b4164e72efa27dd2a3c0143e59f9a965c5e7c13f9123 WatchSource:0}: Error finding container 6bec10959824c7622768b4164e72efa27dd2a3c0143e59f9a965c5e7c13f9123: Status 404 returned error can't find the container with id 6bec10959824c7622768b4164e72efa27dd2a3c0143e59f9a965c5e7c13f9123 Jul 28 00:02:04.875175 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.875157 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8t2hm\"" Jul 28 00:02:04.883992 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:04.883974 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:02:05.017234 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:05.017207 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vf2s"] Jul 28 00:02:05.020526 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:02:05.020497 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a60940_9b1c_499b_85b4_31c44493cc32.slice/crio-20c4ed8955d9ae8e599623a66a7556d3ed3ad0dce61a4ce9109dd574395f8dc3 WatchSource:0}: Error finding container 20c4ed8955d9ae8e599623a66a7556d3ed3ad0dce61a4ce9109dd574395f8dc3: Status 404 returned error can't find the container with id 20c4ed8955d9ae8e599623a66a7556d3ed3ad0dce61a4ce9109dd574395f8dc3 Jul 28 00:02:05.209856 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:05.209802 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vf2s" event={"ID":"87a60940-9b1c-499b-85b4-31c44493cc32","Type":"ContainerStarted","Data":"88b660156ae8e1a8b2246e1d8d049653e3b8910e67c8a298b5ac0ea902d7ada8"} Jul 28 00:02:05.209856 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:05.209847 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vf2s" event={"ID":"87a60940-9b1c-499b-85b4-31c44493cc32","Type":"ContainerStarted","Data":"20c4ed8955d9ae8e599623a66a7556d3ed3ad0dce61a4ce9109dd574395f8dc3"} Jul 28 00:02:05.210006 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:05.209922 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:02:05.211039 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:05.211017 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8mns" event={"ID":"d75b25e5-477e-4784-956b-672905da91a3","Type":"ContainerStarted","Data":"6bec10959824c7622768b4164e72efa27dd2a3c0143e59f9a965c5e7c13f9123"} Jul 28 00:02:05.514882 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:05.514827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:02:05.514882 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:05.514868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:02:05.515258 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:05.514953 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:02:05.515258 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:05.514984 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:05.515258 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:05.515007 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:02:05.515258 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:05.514994 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:02:37.51498197 +0000 UTC m=+99.178959947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:02:05.515258 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:05.515066 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:37.515048809 +0000 UTC m=+99.179026795 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:02:05.615838 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:05.615815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:02:05.616011 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:05.615991 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:02:05.616077 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:05.616058 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:37.616041321 +0000 UTC m=+99.280019314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:02:06.429340 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:06.429300 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:06.529563 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:06.529536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:08.853319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:08.853287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:08.956879 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:08.956850 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:10.227509 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:10.227466 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8mns" event={"ID":"d75b25e5-477e-4784-956b-672905da91a3","Type":"ContainerStarted","Data":"7727a600bcd2edeabbc56490dbe330c4fc300de78b92e961778cca1e61d3718d"} Jul 28 00:02:10.241165 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:10.241119 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8vf2s" podStartSLOduration=71.241102153 podStartE2EDuration="1m11.241102153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:05.225571242 +0000 UTC m=+66.889549240" watchObservedRunningTime="2026-07-28 00:02:10.241102153 +0000 UTC m=+71.905080130" Jul 28 00:02:10.241922 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:10.241883 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b8mns" podStartSLOduration=66.851133725 podStartE2EDuration="1m11.241870576s" totalImagesPullingTime="4.390736851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:10.240958906 +0000 UTC m=+71.904936903" watchObservedRunningTime="2026-07-28 00:02:10.241870576 +0000 UTC m=+71.905848575" Jul 28 00:02:13.898001 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:13.897962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:13.968720 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:13.968691 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:36.216168 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:36.216034 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8vf2s" Jul 28 00:02:37.526444 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:37.526405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:02:37.526918 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:37.526468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:02:37.526918 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:37.526563 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:37.526918 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:37.526565 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:02:37.526918 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:37.526646 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:03:41.52662908 +0000 UTC m=+163.190607056 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:02:37.526918 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:37.526573 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:02:37.526918 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:37.526737 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:03:41.526718991 +0000 UTC m=+163.190696968 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:02:37.627333 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:37.627305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:02:37.627454 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:37.627386 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:02:37.627454 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:02:37.627436 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:03:41.627425998 +0000 UTC m=+163.291403974 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:02:45.033704 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:45.033626 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:02:45.087877 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:02:45.087849 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:04.441260 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:04.441221 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:03:08.632708 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:08.632641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:03:08.633239 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:08.632785 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 00:03:08.633239 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:08.632856 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:10.632837526 +0000 UTC m=+252.296815502 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : secret "metrics-daemon-secret" not found Jul 28 00:03:36.701857 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:36.701804 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" podUID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" Jul 28 00:03:36.723528 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:36.723503 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" podUID="7cf66491-1481-432c-9286-3e56a7efd5dd" Jul 28 00:03:36.731791 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:36.731767 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-htw4s" podUID="e3049a2d-6e5e-446b-b0d5-e18425a57881" Jul 28 00:03:37.428782 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:37.428756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htw4s" Jul 28 00:03:37.428929 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:37.428756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:03:37.428983 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:37.428756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:03:37.887050 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:37.887014 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:03:41.557137 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:41.557090 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:03:41.557137 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:41.557146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:03:41.557650 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:41.557235 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:03:41.557650 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:41.557250 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:03:41.557650 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:41.557253 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77ddbd6f55-95nmj: secret "image-registry-tls" not found Jul 28 00:03:41.557650 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:41.557302 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert podName:7cf66491-1481-432c-9286-3e56a7efd5dd nodeName:}" failed. No retries permitted until 2026-07-28 00:05:43.557289446 +0000 UTC m=+285.221267422 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-pdx68" (UID: "7cf66491-1481-432c-9286-3e56a7efd5dd") : secret "networking-console-plugin-cert" not found Jul 28 00:03:41.557650 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:41.557317 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls podName:fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:43.557310156 +0000 UTC m=+285.221288132 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls") pod "image-registry-77ddbd6f55-95nmj" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4") : secret "image-registry-tls" not found Jul 28 00:03:41.658393 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:41.658362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:03:41.658546 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:41.658510 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:03:41.658599 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:03:41.658578 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls podName:e3049a2d-6e5e-446b-b0d5-e18425a57881 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:43.658563113 +0000 UTC m=+285.322541093 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls") pod "dns-default-htw4s" (UID: "e3049a2d-6e5e-446b-b0d5-e18425a57881") : secret "dns-default-metrics-tls" not found Jul 28 00:03:48.863188 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:03:48.863149 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:05:10.649893 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:10.649845 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:05:10.650365 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:10.649969 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 00:05:10.650365 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:10.650024 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs podName:3f0d0fd9-0703-4cb3-ab02-11dce13801a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:07:12.650008424 +0000 UTC m=+374.313986416 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs") pod "network-metrics-daemon-dtwj5" (UID: "3f0d0fd9-0703-4cb3-ab02-11dce13801a3") : secret "metrics-daemon-secret" not found Jul 28 00:05:16.138312 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.138276 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666"] Jul 28 00:05:16.140505 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.140481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.142751 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.142722 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 00:05:16.142873 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.142751 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:05:16.142873 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.142732 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 00:05:16.143304 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.143284 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-77mg4\"" Jul 28 00:05:16.143525 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.143513 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 00:05:16.157616 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.157593 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666"] Jul 28 00:05:16.238951 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.238920 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7"] Jul 28 00:05:16.241051 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.241035 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:16.243752 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.243731 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cxz6d"] Jul 28 00:05:16.244058 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.244039 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 00:05:16.244270 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.244254 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-c9lc5\"" Jul 28 00:05:16.248299 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.248280 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:05:16.248414 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.248311 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 00:05:16.248921 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.248907 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.251573 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.251554 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lxd46\"" Jul 28 00:05:16.251687 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.251589 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:05:16.251687 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.251600 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 00:05:16.251873 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.251859 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 00:05:16.252341 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.252324 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 00:05:16.257926 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.257910 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 00:05:16.260989 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.260966 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7"] Jul 28 00:05:16.261707 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.261689 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cxz6d"] Jul 28 00:05:16.285420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.285401 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-serving-cert\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.285523 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.285435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-config\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.285523 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.285452 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8jg\" (UniqueName: \"kubernetes.io/projected/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-kube-api-access-hl8jg\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.370898 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.370864 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:16.386804 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.386781 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfm6x\" (UniqueName: \"kubernetes.io/projected/217e5a52-b80a-4f88-8d7c-105fbda43885-kube-api-access-vfm6x\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:16.386924 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.386813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:16.386924 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.386860 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c52f2d7b-8638-42ff-b315-084674fbfa2b-serving-cert\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.386924 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.386899 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-config\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.387051 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.386979 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-serving-cert\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.387051 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.387039 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c52f2d7b-8638-42ff-b315-084674fbfa2b-trusted-ca\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.387144 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.387064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c52f2d7b-8638-42ff-b315-084674fbfa2b-config\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.387144 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.387090 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8jg\" (UniqueName: \"kubernetes.io/projected/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-kube-api-access-hl8jg\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.387144 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.387112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmgn\" (UniqueName: \"kubernetes.io/projected/c52f2d7b-8638-42ff-b315-084674fbfa2b-kube-api-access-kzmgn\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.387375 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.387357 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-config\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.389184 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.389137 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-serving-cert\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.394850 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.394828 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8jg\" (UniqueName: \"kubernetes.io/projected/6fdd80f7-e31b-4a9c-a6de-d6061d1bd935-kube-api-access-hl8jg\") pod \"service-ca-operator-5d6c75f84f-c6666\" (UID: \"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.423007 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.422982 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:16.448967 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.448950 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" Jul 28 00:05:16.487986 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.487955 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c52f2d7b-8638-42ff-b315-084674fbfa2b-trusted-ca\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.488108 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.487995 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c52f2d7b-8638-42ff-b315-084674fbfa2b-config\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.488108 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.488014 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmgn\" (UniqueName: \"kubernetes.io/projected/c52f2d7b-8638-42ff-b315-084674fbfa2b-kube-api-access-kzmgn\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.488108 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.488045 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfm6x\" (UniqueName: \"kubernetes.io/projected/217e5a52-b80a-4f88-8d7c-105fbda43885-kube-api-access-vfm6x\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:16.488108 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.488061 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:16.488108 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.488100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c52f2d7b-8638-42ff-b315-084674fbfa2b-serving-cert\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.488371 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:16.488296 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:05:16.488371 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:16.488352 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls podName:217e5a52-b80a-4f88-8d7c-105fbda43885 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:16.988333315 +0000 UTC m=+258.652311303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls") pod "cluster-samples-operator-6748489656-9lgv7" (UID: "217e5a52-b80a-4f88-8d7c-105fbda43885") : secret "samples-operator-tls" not found Jul 28 00:05:16.488682 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.488649 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c52f2d7b-8638-42ff-b315-084674fbfa2b-config\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.488929 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.488912 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c52f2d7b-8638-42ff-b315-084674fbfa2b-trusted-ca\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.490289 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.490268 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c52f2d7b-8638-42ff-b315-084674fbfa2b-serving-cert\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.496947 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.496925 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmgn\" (UniqueName: \"kubernetes.io/projected/c52f2d7b-8638-42ff-b315-084674fbfa2b-kube-api-access-kzmgn\") pod \"console-operator-584dcb6b54-cxz6d\" (UID: \"c52f2d7b-8638-42ff-b315-084674fbfa2b\") " pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.497072 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.497050 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfm6x\" (UniqueName: \"kubernetes.io/projected/217e5a52-b80a-4f88-8d7c-105fbda43885-kube-api-access-vfm6x\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:16.559225 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.559202 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:16.562995 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.562974 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666"] Jul 28 00:05:16.566427 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:16.566405 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdd80f7_e31b_4a9c_a6de_d6061d1bd935.slice/crio-0fdaeb554cf9ceb0edfd6532e07223265a3fab1e5582839057571aee8f7e5d35 WatchSource:0}: Error finding container 0fdaeb554cf9ceb0edfd6532e07223265a3fab1e5582839057571aee8f7e5d35: Status 404 returned error can't find the container with id 0fdaeb554cf9ceb0edfd6532e07223265a3fab1e5582839057571aee8f7e5d35 Jul 28 00:05:16.666987 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.666920 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" event={"ID":"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935","Type":"ContainerStarted","Data":"0fdaeb554cf9ceb0edfd6532e07223265a3fab1e5582839057571aee8f7e5d35"} Jul 28 00:05:16.679188 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.679165 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cxz6d"] Jul 28 00:05:16.682314 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:16.682286 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52f2d7b_8638_42ff_b315_084674fbfa2b.slice/crio-40321435668faa524ccb19eb9c14cf419ac50bcb62042b2854cff18798e5251a WatchSource:0}: Error finding container 40321435668faa524ccb19eb9c14cf419ac50bcb62042b2854cff18798e5251a: Status 404 returned error can't find the container with id 40321435668faa524ccb19eb9c14cf419ac50bcb62042b2854cff18798e5251a Jul 28 00:05:16.991875 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:16.991812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:16.991992 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:16.991923 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:05:16.991992 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:16.991987 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls podName:217e5a52-b80a-4f88-8d7c-105fbda43885 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:17.99196769 +0000 UTC m=+259.655945667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls") pod "cluster-samples-operator-6748489656-9lgv7" (UID: "217e5a52-b80a-4f88-8d7c-105fbda43885") : secret "samples-operator-tls" not found Jul 28 00:05:17.670535 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:17.670493 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" event={"ID":"c52f2d7b-8638-42ff-b315-084674fbfa2b","Type":"ContainerStarted","Data":"40321435668faa524ccb19eb9c14cf419ac50bcb62042b2854cff18798e5251a"} Jul 28 00:05:18.002151 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:18.002069 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:18.002316 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:18.002247 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:05:18.002376 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:18.002326 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls podName:217e5a52-b80a-4f88-8d7c-105fbda43885 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:20.002306359 +0000 UTC m=+261.666284335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls") pod "cluster-samples-operator-6748489656-9lgv7" (UID: "217e5a52-b80a-4f88-8d7c-105fbda43885") : secret "samples-operator-tls" not found Jul 28 00:05:18.727228 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:18.727185 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:19.678155 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:19.678126 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/0.log" Jul 28 00:05:19.678324 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:19.678174 2558 generic.go:356] "Generic (PLEG): container finished" podID="c52f2d7b-8638-42ff-b315-084674fbfa2b" containerID="6ab8adbf4350809541b19c9467e92ca985c135c05dcbd1d66e84adef5cf6905e" exitCode=255 Jul 28 00:05:19.678324 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:19.678262 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" event={"ID":"c52f2d7b-8638-42ff-b315-084674fbfa2b","Type":"ContainerDied","Data":"6ab8adbf4350809541b19c9467e92ca985c135c05dcbd1d66e84adef5cf6905e"} Jul 28 00:05:19.678485 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:19.678468 2558 scope.go:117] "RemoveContainer" containerID="6ab8adbf4350809541b19c9467e92ca985c135c05dcbd1d66e84adef5cf6905e" Jul 28 00:05:19.679843 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:19.679809 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" event={"ID":"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935","Type":"ContainerStarted","Data":"1dcb42dcd611aba880778554453e7ffceddda026216668c763d427f14fb11a7a"} Jul 28 00:05:19.710828 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:19.710789 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" podStartSLOduration=1.32228703 podStartE2EDuration="3.710775378s" totalImagesPullingTime="2.388488348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:19.710183726 +0000 UTC m=+261.374161724" watchObservedRunningTime="2026-07-28 00:05:19.710775378 +0000 UTC m=+261.374753418" Jul 28 00:05:20.019177 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.019086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:20.019536 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:20.019278 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:05:20.019536 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:20.019367 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls podName:217e5a52-b80a-4f88-8d7c-105fbda43885 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:24.0193482 +0000 UTC m=+265.683326182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls") pod "cluster-samples-operator-6748489656-9lgv7" (UID: "217e5a52-b80a-4f88-8d7c-105fbda43885") : secret "samples-operator-tls" not found Jul 28 00:05:20.024242 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.024210 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72"] Jul 28 00:05:20.026163 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.026144 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" Jul 28 00:05:20.029044 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.029028 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 00:05:20.029294 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.029277 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 00:05:20.030898 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.030880 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pm7pn\"" Jul 28 00:05:20.034124 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.034101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:20.041412 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.041389 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72"] Jul 28 00:05:20.120323 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.120278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92ht7\" (UniqueName: \"kubernetes.io/projected/cb3fce77-cc6b-45c7-a889-8eff941fadc9-kube-api-access-92ht7\") pod \"migrator-6865c9967-pbj72\" (UID: \"cb3fce77-cc6b-45c7-a889-8eff941fadc9\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" Jul 28 00:05:20.170495 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.170461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:20.220885 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.220856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92ht7\" (UniqueName: \"kubernetes.io/projected/cb3fce77-cc6b-45c7-a889-8eff941fadc9-kube-api-access-92ht7\") pod \"migrator-6865c9967-pbj72\" (UID: \"cb3fce77-cc6b-45c7-a889-8eff941fadc9\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" Jul 28 00:05:20.228784 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.228760 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92ht7\" (UniqueName: \"kubernetes.io/projected/cb3fce77-cc6b-45c7-a889-8eff941fadc9-kube-api-access-92ht7\") pod \"migrator-6865c9967-pbj72\" (UID: \"cb3fce77-cc6b-45c7-a889-8eff941fadc9\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" Jul 28 00:05:20.334320 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.334236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" Jul 28 00:05:20.449974 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.449945 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72"] Jul 28 00:05:20.453070 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:20.453039 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3fce77_cc6b_45c7_a889_8eff941fadc9.slice/crio-6998e51a8522096cbb266dcb83db077e3e77609429e79c73022f4c7586f2a72f WatchSource:0}: Error finding container 6998e51a8522096cbb266dcb83db077e3e77609429e79c73022f4c7586f2a72f: Status 404 returned error can't find the container with id 6998e51a8522096cbb266dcb83db077e3e77609429e79c73022f4c7586f2a72f Jul 28 00:05:20.515858 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.515803 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bh6wr"] Jul 28 00:05:20.518379 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.518362 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.520611 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.520586 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 00:05:20.520611 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.520601 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5zxjk\"" Jul 28 00:05:20.520780 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.520628 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 00:05:20.520892 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.520878 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 00:05:20.521387 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.521373 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 00:05:20.532634 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.532577 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bh6wr"] Jul 28 00:05:20.545763 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.545733 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:20.625801 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.625773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlqhp\" (UniqueName: \"kubernetes.io/projected/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-api-access-jlqhp\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.625926 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.625813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07720ded-c51d-4fd1-aa97-a6e66125ec67-data-volume\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.625926 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.625837 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.625926 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.625865 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07720ded-c51d-4fd1-aa97-a6e66125ec67-crio-socket\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.625926 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.625885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.676150 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.676116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:20.683776 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.683752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" event={"ID":"cb3fce77-cc6b-45c7-a889-8eff941fadc9","Type":"ContainerStarted","Data":"6998e51a8522096cbb266dcb83db077e3e77609429e79c73022f4c7586f2a72f"} Jul 28 00:05:20.685092 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.685075 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/1.log" Jul 28 00:05:20.685500 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.685483 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/0.log" Jul 28 00:05:20.685580 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.685519 2558 generic.go:356] "Generic (PLEG): container finished" podID="c52f2d7b-8638-42ff-b315-084674fbfa2b" containerID="f85b15c419c4203c62b30a2208c47309258ab5434626d4f66d6146f21a0f8710" exitCode=255 Jul 28 00:05:20.685580 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.685554 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" event={"ID":"c52f2d7b-8638-42ff-b315-084674fbfa2b","Type":"ContainerDied","Data":"f85b15c419c4203c62b30a2208c47309258ab5434626d4f66d6146f21a0f8710"} Jul 28 00:05:20.685657 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.685600 2558 scope.go:117] "RemoveContainer" containerID="6ab8adbf4350809541b19c9467e92ca985c135c05dcbd1d66e84adef5cf6905e" Jul 28 00:05:20.685817 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.685799 2558 scope.go:117] "RemoveContainer" containerID="f85b15c419c4203c62b30a2208c47309258ab5434626d4f66d6146f21a0f8710" Jul 28 00:05:20.686024 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:20.686003 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cxz6d_openshift-console-operator(c52f2d7b-8638-42ff-b315-084674fbfa2b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" podUID="c52f2d7b-8638-42ff-b315-084674fbfa2b" Jul 28 00:05:20.726752 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.726729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlqhp\" (UniqueName: \"kubernetes.io/projected/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-api-access-jlqhp\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.726866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.726766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07720ded-c51d-4fd1-aa97-a6e66125ec67-data-volume\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.726866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.726786 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.726866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.726822 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07720ded-c51d-4fd1-aa97-a6e66125ec67-crio-socket\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.726866 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.726841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.727061 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:20.726955 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:20.727061 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:20.726963 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:20.727061 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.726973 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07720ded-c51d-4fd1-aa97-a6e66125ec67-crio-socket\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.727061 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:20.727018 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:21.22700079 +0000 UTC m=+262.890978766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:20.727061 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.727032 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07720ded-c51d-4fd1-aa97-a6e66125ec67-data-volume\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.727061 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:20.727042 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:21.227025668 +0000 UTC m=+262.891003646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : configmap "kube-rbac-proxy" not found Jul 28 00:05:20.734479 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.734451 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlqhp\" (UniqueName: \"kubernetes.io/projected/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-api-access-jlqhp\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:20.776848 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:20.776822 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:21.232913 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.232866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:21.233698 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:21.233000 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:21.233698 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.233039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:21.233698 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:21.233066 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:22.233052794 +0000 UTC m=+263.897030775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : configmap "kube-rbac-proxy" not found Jul 28 00:05:21.233698 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:21.233126 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:21.233698 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:21.233187 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:22.233171111 +0000 UTC m=+263.897149106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:21.390386 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.390348 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:21.489986 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.489953 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:21.691159 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.691131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" event={"ID":"cb3fce77-cc6b-45c7-a889-8eff941fadc9","Type":"ContainerStarted","Data":"eb3499b0020019e5debeaa4a7eb5b2ad06ddb363f694a77519f6cdb138929c4d"} Jul 28 00:05:21.691291 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.691212 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" event={"ID":"cb3fce77-cc6b-45c7-a889-8eff941fadc9","Type":"ContainerStarted","Data":"d3c748f536bfa4bfc1b76f1d870bacca908a6174ba8b3a04f7a7c3d5c97c729d"} Jul 28 00:05:21.692483 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.692466 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/1.log" Jul 28 00:05:21.692767 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.692751 2558 scope.go:117] "RemoveContainer" containerID="f85b15c419c4203c62b30a2208c47309258ab5434626d4f66d6146f21a0f8710" Jul 28 00:05:21.692920 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:21.692899 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cxz6d_openshift-console-operator(c52f2d7b-8638-42ff-b315-084674fbfa2b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" podUID="c52f2d7b-8638-42ff-b315-084674fbfa2b" Jul 28 00:05:21.705448 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:21.705413 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-pbj72" podStartSLOduration=0.681969428 podStartE2EDuration="1.705401339s" totalImagesPullingTime="1.023431911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:21.704852258 +0000 UTC m=+263.368830256" watchObservedRunningTime="2026-07-28 00:05:21.705401339 +0000 UTC m=+263.369379391" Jul 28 00:05:22.096912 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:22.096882 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:22.151619 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:22.151595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:22.240856 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:22.240833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:22.241155 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:22.240866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:22.241155 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:22.240957 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:22.241155 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:22.240955 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:22.241155 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:22.240998 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:24.24098394 +0000 UTC m=+265.904961917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:22.241155 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:22.241022 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:24.241006381 +0000 UTC m=+265.904984358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : configmap "kube-rbac-proxy" not found Jul 28 00:05:23.017262 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:23.017226 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:23.073823 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:23.073789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:23.501727 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:23.501700 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zrkn7_d53ee3dc-2347-4ca8-b291-8cc159b35b3a/dns-node-resolver/0.log" Jul 28 00:05:23.701011 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:23.700986 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29753280-pswrj_ff980859-8405-4c8d-a225-f5d65b0afcab/image-pruner/0.log" Jul 28 00:05:24.053279 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:24.053245 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:24.053462 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:24.053398 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:05:24.053462 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:24.053456 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls podName:217e5a52-b80a-4f88-8d7c-105fbda43885 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:32.053440106 +0000 UTC m=+273.717418088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls") pod "cluster-samples-operator-6748489656-9lgv7" (UID: "217e5a52-b80a-4f88-8d7c-105fbda43885") : secret "samples-operator-tls" not found Jul 28 00:05:24.254799 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:24.254745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:24.254972 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:24.254859 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:24.254972 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:24.254884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:24.254972 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:24.254926 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:28.254909367 +0000 UTC m=+269.918887343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : configmap "kube-rbac-proxy" not found Jul 28 00:05:24.255081 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:24.254974 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:24.255081 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:24.255022 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:28.255009168 +0000 UTC m=+269.918987149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:24.298826 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:24.298802 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-76s8v_86e539ab-26b7-4771-acfb-8dfa0bbde7b9/node-ca/0.log" Jul 28 00:05:24.307423 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:24.307335 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:24.391840 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:24.391787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:25.498445 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:25.498416 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k95mb_dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d/serve-healthcheck-canary/0.log" Jul 28 00:05:25.698923 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:25.698897 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-pbj72_cb3fce77-cc6b-45c7-a889-8eff941fadc9/migrator/0.log" Jul 28 00:05:25.899031 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:25.899002 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-pbj72_cb3fce77-cc6b-45c7-a889-8eff941fadc9/graceful-termination/0.log" Jul 28 00:05:26.559604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:26.559529 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:26.559604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:26.559578 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:26.559987 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:26.559885 2558 scope.go:117] "RemoveContainer" containerID="f85b15c419c4203c62b30a2208c47309258ab5434626d4f66d6146f21a0f8710" Jul 28 00:05:26.560035 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:26.560016 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cxz6d_openshift-console-operator(c52f2d7b-8638-42ff-b315-084674fbfa2b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" podUID="c52f2d7b-8638-42ff-b315-084674fbfa2b" Jul 28 00:05:26.875637 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:26.875593 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:27.112315 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:27.112290 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:27.214080 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:27.213984 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:27.276899 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:27.276872 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:27.354517 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:27.354480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:27.872875 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:27.872835 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:28.288635 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:28.288538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:28.288635 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:28.288599 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:28.288827 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:28.288689 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:28.288827 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:28.288734 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:28.288827 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:28.288755 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:36.288740252 +0000 UTC m=+277.952718228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : configmap "kube-rbac-proxy" not found Jul 28 00:05:28.288827 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:28.288773 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:36.288762138 +0000 UTC m=+277.952740114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:28.762118 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:28.762087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:28.970636 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:28.970600 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:29.173514 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:29.173486 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:29.371654 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:29.371621 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:29.569138 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:29.569058 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:31.042575 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:31.042535 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:31.115639 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:31.115611 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:31.182556 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:31.182531 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:31.364738 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:31.364661 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:31.567962 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:31.567942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:32.115254 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:32.115229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:32.117578 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:32.117559 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/217e5a52-b80a-4f88-8d7c-105fbda43885-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-9lgv7\" (UID: \"217e5a52-b80a-4f88-8d7c-105fbda43885\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:32.154143 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:32.154120 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" Jul 28 00:05:32.273382 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:32.273356 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7"] Jul 28 00:05:32.577329 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:32.577297 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:32.724660 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:32.724634 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" event={"ID":"217e5a52-b80a-4f88-8d7c-105fbda43885","Type":"ContainerStarted","Data":"812bd403ff5c031f57186fa6e4ac16b5165d3082c1d3fe9d4fc679d20f528a99"} Jul 28 00:05:32.964288 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:32.964261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:33.297027 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:33.296962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:33.398175 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:33.398150 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:33.460587 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:33.460566 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:33.563480 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:33.563428 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:34.367734 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:34.367699 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:34.732902 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:34.732878 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" event={"ID":"217e5a52-b80a-4f88-8d7c-105fbda43885","Type":"ContainerStarted","Data":"d7a83f884acb45ee41e421d94ca8c40b3475e51f99be43f6a60ca29575f646f0"} Jul 28 00:05:34.768870 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:34.768842 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:34.887507 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:34.887475 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:34.976248 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:34.976179 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:35.635174 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:35.635141 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:35.735221 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:35.735173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:35.737770 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:35.737746 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" event={"ID":"217e5a52-b80a-4f88-8d7c-105fbda43885","Type":"ContainerStarted","Data":"17634e65adfafa661d1ecfce5b40a534f9e6c5a6f0c010883186d737990cd278"} Jul 28 00:05:35.752979 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:35.752942 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-9lgv7" podStartSLOduration=17.393841067 podStartE2EDuration="19.752932135s" totalImagesPullingTime="2.359091068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:35.752487428 +0000 UTC m=+277.416465426" watchObservedRunningTime="2026-07-28 00:05:35.752932135 +0000 UTC m=+277.416910132" Jul 28 00:05:35.791272 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:35.791253 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:36.340887 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:36.340858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:36.341013 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:36.340893 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:36.341073 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:36.341064 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:36.341124 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:36.341113 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls podName:07720ded-c51d-4fd1-aa97-a6e66125ec67 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:52.341100108 +0000 UTC m=+294.005078084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bh6wr" (UID: "07720ded-c51d-4fd1-aa97-a6e66125ec67") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:36.341377 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:36.341356 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07720ded-c51d-4fd1-aa97-a6e66125ec67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:36.808983 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:36.808947 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:36.865397 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:36.865368 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:36.968894 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:36.968868 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:37.367115 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:37.367088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:37.938630 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:37.938601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:40.429255 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:40.429211 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" podUID="7cf66491-1481-432c-9286-3e56a7efd5dd" Jul 28 00:05:40.429255 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:40.429223 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-htw4s" podUID="e3049a2d-6e5e-446b-b0d5-e18425a57881" Jul 28 00:05:40.429255 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:40.429227 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" podUID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" Jul 28 00:05:40.753217 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:40.753144 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:05:40.753367 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:40.753146 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:05:40.753367 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:40.753160 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htw4s" Jul 28 00:05:40.861221 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:40.861185 2558 scope.go:117] "RemoveContainer" containerID="f85b15c419c4203c62b30a2208c47309258ab5434626d4f66d6146f21a0f8710" Jul 28 00:05:41.758087 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:41.758055 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/1.log" Jul 28 00:05:41.758620 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:41.758146 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" event={"ID":"c52f2d7b-8638-42ff-b315-084674fbfa2b","Type":"ContainerStarted","Data":"ef2a2779c6ba7762d29bb83f379916739bed9d9cc110eebabd9e37a03cebe15f"} Jul 28 00:05:41.758620 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:41.758431 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:41.774012 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:41.773955 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" podStartSLOduration=23.501236129 podStartE2EDuration="25.773939767s" totalImagesPullingTime="2.272703638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:41.77298092 +0000 UTC m=+283.436958916" watchObservedRunningTime="2026-07-28 00:05:41.773939767 +0000 UTC m=+283.437917767" Jul 28 00:05:42.226661 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:42.226632 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-cxz6d" Jul 28 00:05:43.055848 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.055809 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:43.155293 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.155266 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:43.594971 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.594935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:05:43.595140 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.594979 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:05:43.597284 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.597263 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"image-registry-77ddbd6f55-95nmj\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:05:43.597395 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.597262 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7cf66491-1481-432c-9286-3e56a7efd5dd-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-pdx68\" (UID: \"7cf66491-1481-432c-9286-3e56a7efd5dd\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:05:43.695879 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.695847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:05:43.697956 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.697935 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3049a2d-6e5e-446b-b0d5-e18425a57881-metrics-tls\") pod \"dns-default-htw4s\" (UID: \"e3049a2d-6e5e-446b-b0d5-e18425a57881\") " pod="openshift-dns/dns-default-htw4s" Jul 28 00:05:43.729699 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.729653 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:43.756043 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.756013 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wxjjr\"" Jul 28 00:05:43.756570 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.756553 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g2k9m\"" Jul 28 00:05:43.756685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.756588 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hfm8c\"" Jul 28 00:05:43.764116 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.764100 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:05:43.764116 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.764118 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" Jul 28 00:05:43.764245 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.764136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htw4s" Jul 28 00:05:43.882280 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.882249 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:43.926461 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.926429 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-htw4s"] Jul 28 00:05:43.928851 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:43.928817 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3049a2d_6e5e_446b_b0d5_e18425a57881.slice/crio-36ef1750ca8329cbe5caf92faa78914510615dac50ab1104ed549eb027b6a091 WatchSource:0}: Error finding container 36ef1750ca8329cbe5caf92faa78914510615dac50ab1104ed549eb027b6a091: Status 404 returned error can't find the container with id 36ef1750ca8329cbe5caf92faa78914510615dac50ab1104ed549eb027b6a091 Jul 28 00:05:43.947114 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.947093 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-pdx68"] Jul 28 00:05:43.949448 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:43.949427 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf66491_1481_432c_9286_3e56a7efd5dd.slice/crio-4c85d1e5d30b9243078487057ffd5d1de2a7719815dc3971a5b65769c09fec64 WatchSource:0}: Error finding container 4c85d1e5d30b9243078487057ffd5d1de2a7719815dc3971a5b65769c09fec64: Status 404 returned error can't find the container with id 4c85d1e5d30b9243078487057ffd5d1de2a7719815dc3971a5b65769c09fec64 Jul 28 00:05:43.952971 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.952889 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77ddbd6f55-95nmj"] Jul 28 00:05:43.955308 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:43.955283 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8236cf_4ab7_4cc0_9b19_1d65c9b850b4.slice/crio-ace4c5a6e8731acca3d131d9fee008104b9ba8b3f9f425cb9ee8d71b661f34fb WatchSource:0}: Error finding container ace4c5a6e8731acca3d131d9fee008104b9ba8b3f9f425cb9ee8d71b661f34fb: Status 404 returned error can't find the container with id ace4c5a6e8731acca3d131d9fee008104b9ba8b3f9f425cb9ee8d71b661f34fb Jul 28 00:05:43.982811 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:43.982778 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:44.100881 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.100840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:44.296329 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.296291 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:44.491216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.491178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:44.771397 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.771361 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htw4s" event={"ID":"e3049a2d-6e5e-446b-b0d5-e18425a57881","Type":"ContainerStarted","Data":"36ef1750ca8329cbe5caf92faa78914510615dac50ab1104ed549eb027b6a091"} Jul 28 00:05:44.772497 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.772469 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" event={"ID":"7cf66491-1481-432c-9286-3e56a7efd5dd","Type":"ContainerStarted","Data":"4c85d1e5d30b9243078487057ffd5d1de2a7719815dc3971a5b65769c09fec64"} Jul 28 00:05:44.773820 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.773801 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" event={"ID":"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4","Type":"ContainerStarted","Data":"8299709fdf5ea61e7e8ac413fdb65e2dc5ac9bab0df902085dd288ceef37b94b"} Jul 28 00:05:44.773913 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.773831 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" event={"ID":"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4","Type":"ContainerStarted","Data":"ace4c5a6e8731acca3d131d9fee008104b9ba8b3f9f425cb9ee8d71b661f34fb"} Jul 28 00:05:44.773972 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.773940 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:05:44.792032 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.791993 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" podStartSLOduration=285.791982347 podStartE2EDuration="4m45.791982347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:44.79109037 +0000 UTC m=+286.455068364" watchObservedRunningTime="2026-07-28 00:05:44.791982347 +0000 UTC m=+286.455960345" Jul 28 00:05:44.998936 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:44.998898 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:45.761092 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:45.760968 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:46.781659 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:46.781579 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htw4s" event={"ID":"e3049a2d-6e5e-446b-b0d5-e18425a57881","Type":"ContainerStarted","Data":"b1fb739e3b8a84e96554d736752f418898741f0678e77cd0c94b2a52949dfeac"} Jul 28 00:05:46.781659 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:46.781628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htw4s" event={"ID":"e3049a2d-6e5e-446b-b0d5-e18425a57881","Type":"ContainerStarted","Data":"05b7da8519d347dd181649f8a1246702e15300afc2ed6705cc26573b6098e233"} Jul 28 00:05:46.782122 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:46.781684 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-htw4s" Jul 28 00:05:46.783016 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:46.782985 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" event={"ID":"7cf66491-1481-432c-9286-3e56a7efd5dd","Type":"ContainerStarted","Data":"68ae1b93fa1ebb29368f13fc59174a034dda38c33b8ffa029860dacc0765909c"} Jul 28 00:05:46.798830 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:46.798786 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-htw4s" podStartSLOduration=251.257547938 podStartE2EDuration="4m13.798771948s" totalImagesPullingTime="2.54122401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:46.798202769 +0000 UTC m=+288.462180766" watchObservedRunningTime="2026-07-28 00:05:46.798771948 +0000 UTC m=+288.462749925" Jul 28 00:05:46.812908 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:46.812778 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-pdx68" podStartSLOduration=260.742729543 podStartE2EDuration="4m22.812760623s" totalImagesPullingTime="2.07003108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:46.811577771 +0000 UTC m=+288.475555768" watchObservedRunningTime="2026-07-28 00:05:46.812760623 +0000 UTC m=+288.476738621" Jul 28 00:05:46.916470 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:46.916441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:46.976133 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:46.976107 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:50.559358 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.559319 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:50.657018 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.656987 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:50.721527 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.721501 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n"] Jul 28 00:05:50.723539 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.723524 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" Jul 28 00:05:50.725380 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.725356 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:50.725503 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.725429 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 00:05:50.725561 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.725429 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wthhj\"" Jul 28 00:05:50.732465 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.732442 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n"] Jul 28 00:05:50.748820 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.748801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6f4a586e-6e1b-4bae-8aec-93b56aa4b904-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-g588n\" (UID: \"6f4a586e-6e1b-4bae-8aec-93b56aa4b904\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" Jul 28 00:05:50.849255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.849202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6f4a586e-6e1b-4bae-8aec-93b56aa4b904-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-g588n\" (UID: \"6f4a586e-6e1b-4bae-8aec-93b56aa4b904\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" Jul 28 00:05:50.849338 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:50.849300 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 28 00:05:50.849382 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:50.849344 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f4a586e-6e1b-4bae-8aec-93b56aa4b904-tls-certificates podName:6f4a586e-6e1b-4bae-8aec-93b56aa4b904 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:51.349331996 +0000 UTC m=+293.013309973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/6f4a586e-6e1b-4bae-8aec-93b56aa4b904-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-g588n" (UID: "6f4a586e-6e1b-4bae-8aec-93b56aa4b904") : secret "prometheus-operator-admission-webhook-tls" not found Jul 28 00:05:50.960904 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:50.960881 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:51.351680 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.351638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6f4a586e-6e1b-4bae-8aec-93b56aa4b904-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-g588n\" (UID: \"6f4a586e-6e1b-4bae-8aec-93b56aa4b904\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" Jul 28 00:05:51.353846 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.353828 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6f4a586e-6e1b-4bae-8aec-93b56aa4b904-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-g588n\" (UID: \"6f4a586e-6e1b-4bae-8aec-93b56aa4b904\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" Jul 28 00:05:51.632271 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.632246 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" Jul 28 00:05:51.745868 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.745841 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n"] Jul 28 00:05:51.749036 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:51.749010 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4a586e_6e1b_4bae_8aec_93b56aa4b904.slice/crio-8f0987a904f9fe73fee20a76bc7004acd7b61e206f76d1827c02926241ecbc0d WatchSource:0}: Error finding container 8f0987a904f9fe73fee20a76bc7004acd7b61e206f76d1827c02926241ecbc0d: Status 404 returned error can't find the container with id 8f0987a904f9fe73fee20a76bc7004acd7b61e206f76d1827c02926241ecbc0d Jul 28 00:05:51.800251 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.800222 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" event={"ID":"6f4a586e-6e1b-4bae-8aec-93b56aa4b904","Type":"ContainerStarted","Data":"8f0987a904f9fe73fee20a76bc7004acd7b61e206f76d1827c02926241ecbc0d"} Jul 28 00:05:51.864336 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:51.864307 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dtwj5" podUID="3f0d0fd9-0703-4cb3-ab02-11dce13801a3" Jul 28 00:05:51.915218 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.915161 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cfdd7dd66-sc42b"] Jul 28 00:05:51.917868 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.917849 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:51.919939 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.919916 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 00:05:51.920017 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.919966 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 00:05:51.920593 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.920571 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 00:05:51.920761 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.920610 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 00:05:51.920761 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.920636 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 00:05:51.920761 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.920727 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f98sw\"" Jul 28 00:05:51.920761 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.920729 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 00:05:51.920992 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.920976 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 00:05:51.928704 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.928685 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfdd7dd66-sc42b"] Jul 28 00:05:51.956088 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.956063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fts5g\" (UniqueName: \"kubernetes.io/projected/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-kube-api-access-fts5g\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:51.956176 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.956111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-oauth-config\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:51.956176 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.956160 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-serving-cert\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:51.956256 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.956187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-service-ca\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:51.956256 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.956235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-config\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:51.956256 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:51.956253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-oauth-serving-cert\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057046 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-config\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057135 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057117 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-oauth-serving-cert\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057177 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fts5g\" (UniqueName: \"kubernetes.io/projected/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-kube-api-access-fts5g\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057219 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057190 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-oauth-config\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057367 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-serving-cert\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057419 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057385 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-service-ca\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057607 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057585 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-config\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057738 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057721 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-oauth-serving-cert\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.057964 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.057946 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-service-ca\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.059295 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.059271 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-oauth-config\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.059532 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.059513 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-serving-cert\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.065724 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.065658 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fts5g\" (UniqueName: \"kubernetes.io/projected/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-kube-api-access-fts5g\") pod \"console-cfdd7dd66-sc42b\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.227076 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.227031 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:05:52.345104 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.345071 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfdd7dd66-sc42b"] Jul 28 00:05:52.348229 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:52.348203 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fcf1b5_a5a4_42f4_8c18_987ac0889ff5.slice/crio-a1e50cc9d7ce2739ba4e81558f2b16d6450f222cce0cf21a25d8aadd45f9852f WatchSource:0}: Error finding container a1e50cc9d7ce2739ba4e81558f2b16d6450f222cce0cf21a25d8aadd45f9852f: Status 404 returned error can't find the container with id a1e50cc9d7ce2739ba4e81558f2b16d6450f222cce0cf21a25d8aadd45f9852f Jul 28 00:05:52.360213 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.360187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:52.363033 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.363000 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07720ded-c51d-4fd1-aa97-a6e66125ec67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bh6wr\" (UID: \"07720ded-c51d-4fd1-aa97-a6e66125ec67\") " pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:52.628754 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.628722 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bh6wr" Jul 28 00:05:52.804614 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.804584 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfdd7dd66-sc42b" event={"ID":"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5","Type":"ContainerStarted","Data":"a1e50cc9d7ce2739ba4e81558f2b16d6450f222cce0cf21a25d8aadd45f9852f"} Jul 28 00:05:52.914814 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:52.914728 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bh6wr"] Jul 28 00:05:52.918728 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:52.918638 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07720ded_c51d_4fd1_aa97_a6e66125ec67.slice/crio-2f16348a4cf64b356c67cfeb6a6622ef8d330dd483c1f8bd1d709d6d32996834 WatchSource:0}: Error finding container 2f16348a4cf64b356c67cfeb6a6622ef8d330dd483c1f8bd1d709d6d32996834: Status 404 returned error can't find the container with id 2f16348a4cf64b356c67cfeb6a6622ef8d330dd483c1f8bd1d709d6d32996834 Jul 28 00:05:53.809709 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:53.809659 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" event={"ID":"6f4a586e-6e1b-4bae-8aec-93b56aa4b904","Type":"ContainerStarted","Data":"4327b3db29e96f695a7b388f3412c537e73fdb1d40935d0f9027fe86433316e8"} Jul 28 00:05:53.810158 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:53.809893 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" Jul 28 00:05:53.811733 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:53.811704 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bh6wr" event={"ID":"07720ded-c51d-4fd1-aa97-a6e66125ec67","Type":"ContainerStarted","Data":"2f16348a4cf64b356c67cfeb6a6622ef8d330dd483c1f8bd1d709d6d32996834"} Jul 28 00:05:53.814773 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:53.814752 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" Jul 28 00:05:53.827207 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:53.827167 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-g588n" podStartSLOduration=2.767058311 podStartE2EDuration="3.827150488s" totalImagesPullingTime="1.060092177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:53.826353369 +0000 UTC m=+295.490331367" watchObservedRunningTime="2026-07-28 00:05:53.827150488 +0000 UTC m=+295.491128484" Jul 28 00:05:54.750756 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.750678 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:54.791547 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.789644 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-26nkz"] Jul 28 00:05:54.792876 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.792849 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.795961 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.795631 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 00:05:54.795961 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.795631 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 00:05:54.795961 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.795753 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 00:05:54.795961 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.795901 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 00:05:54.796197 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.795985 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xm79b\"" Jul 28 00:05:54.796197 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.796081 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 00:05:54.801440 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.801423 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-26nkz"] Jul 28 00:05:54.823840 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.823811 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:54.881625 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.881597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tt2m\" (UniqueName: \"kubernetes.io/projected/dfc50906-d30b-419f-ac07-98a3177970dd-kube-api-access-2tt2m\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.881920 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.881642 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.881920 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.881735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc50906-d30b-419f-ac07-98a3177970dd-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.881920 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.881773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.982155 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.982120 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc50906-d30b-419f-ac07-98a3177970dd-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.982328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.982181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.982328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.982229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tt2m\" (UniqueName: \"kubernetes.io/projected/dfc50906-d30b-419f-ac07-98a3177970dd-kube-api-access-2tt2m\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.982328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.982256 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.982489 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:54.982381 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 00:05:54.982489 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:05:54.982431 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-tls podName:dfc50906-d30b-419f-ac07-98a3177970dd nodeName:}" failed. No retries permitted until 2026-07-28 00:05:55.482415694 +0000 UTC m=+297.146393670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-26nkz" (UID: "dfc50906-d30b-419f-ac07-98a3177970dd") : secret "prometheus-operator-tls" not found Jul 28 00:05:54.982974 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.982926 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc50906-d30b-419f-ac07-98a3177970dd-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.985701 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.985677 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:54.992938 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:54.992914 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tt2m\" (UniqueName: \"kubernetes.io/projected/dfc50906-d30b-419f-ac07-98a3177970dd-kube-api-access-2tt2m\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:55.089419 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:55.089340 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:55.485776 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:55.485733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:55.488430 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:55.488399 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dfc50906-d30b-419f-ac07-98a3177970dd-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-26nkz\" (UID: \"dfc50906-d30b-419f-ac07-98a3177970dd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:55.704869 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:55.704839 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" Jul 28 00:05:55.823592 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:55.823556 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfdd7dd66-sc42b" event={"ID":"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5","Type":"ContainerStarted","Data":"7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0"} Jul 28 00:05:55.842236 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:55.842171 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-26nkz"] Jul 28 00:05:55.844857 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:55.844805 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cfdd7dd66-sc42b" podStartSLOduration=1.676849383 podStartE2EDuration="4.844785982s" totalImagesPullingTime="3.167936599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:55.843548632 +0000 UTC m=+297.507526633" watchObservedRunningTime="2026-07-28 00:05:55.844785982 +0000 UTC m=+297.508763980" Jul 28 00:05:55.846333 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:05:55.846306 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc50906_d30b_419f_ac07_98a3177970dd.slice/crio-b6f41665bd6f1f8cf21ba4eb3e275c7fec9720a457788c8d65314db4a51db803 WatchSource:0}: Error finding container b6f41665bd6f1f8cf21ba4eb3e275c7fec9720a457788c8d65314db4a51db803: Status 404 returned error can't find the container with id b6f41665bd6f1f8cf21ba4eb3e275c7fec9720a457788c8d65314db4a51db803 Jul 28 00:05:56.788985 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:56.788951 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-htw4s" Jul 28 00:05:56.829086 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:56.829046 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" event={"ID":"dfc50906-d30b-419f-ac07-98a3177970dd","Type":"ContainerStarted","Data":"b6f41665bd6f1f8cf21ba4eb3e275c7fec9720a457788c8d65314db4a51db803"} Jul 28 00:05:57.238197 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:57.238164 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:57.340331 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:57.340289 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:57.398586 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:57.398552 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:58.898854 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:58.898829 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/1.log" Jul 28 00:05:58.900120 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:58.899273 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/1.log" Jul 28 00:05:58.909315 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:58.909299 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 00:05:59.178437 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:59.178351 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:05:59.839795 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:59.839758 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bh6wr" event={"ID":"07720ded-c51d-4fd1-aa97-a6e66125ec67","Type":"ContainerStarted","Data":"93c58626c1acbd7e908bebed607fb5af90f505bea6645d510c6b5b9935ab86c8"} Jul 28 00:05:59.841576 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:59.841548 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" event={"ID":"dfc50906-d30b-419f-ac07-98a3177970dd","Type":"ContainerStarted","Data":"3398042e3c21116c10c20cad15d1dc23856a08efa4713db5b8825d211c940b5a"} Jul 28 00:05:59.841739 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:59.841591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" event={"ID":"dfc50906-d30b-419f-ac07-98a3177970dd","Type":"ContainerStarted","Data":"4aacb093503daa2e1b053de602b3082f0f9ba5531332ca8241ef1dc2f698c8fb"} Jul 28 00:05:59.858948 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:05:59.858903 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-26nkz" podStartSLOduration=2.7752565369999997 podStartE2EDuration="5.858889258s" totalImagesPullingTime="3.083632721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:59.857295816 +0000 UTC m=+301.521273813" watchObservedRunningTime="2026-07-28 00:05:59.858889258 +0000 UTC m=+301.522867255" Jul 28 00:06:00.922022 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:00.921976 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:02.179233 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.179199 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hpjpb"] Jul 28 00:06:02.204267 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.204245 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.206125 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.206107 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tt4cg\"" Jul 28 00:06:02.206522 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.206506 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 00:06:02.206802 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.206788 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 00:06:02.206875 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.206856 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 00:06:02.227349 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.227322 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:06:02.227473 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.227379 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:06:02.232473 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.232442 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:06:02.340658 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.340617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.340846 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.340687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-root\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.340846 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.340777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jdw\" (UniqueName: \"kubernetes.io/projected/2aca83c4-cff7-4a09-acb1-24f7863732fb-kube-api-access-r5jdw\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.340846 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.340832 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-wtmp\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.341002 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.340940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aca83c4-cff7-4a09-acb1-24f7863732fb-metrics-client-ca\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.341002 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.340967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.341097 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.341045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-textfile\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.341097 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.341068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.341191 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.341116 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-sys\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442001 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.441916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jdw\" (UniqueName: \"kubernetes.io/projected/2aca83c4-cff7-4a09-acb1-24f7863732fb-kube-api-access-r5jdw\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442001 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.441961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-wtmp\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aca83c4-cff7-4a09-acb1-24f7863732fb-metrics-client-ca\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442056 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-textfile\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442117 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442133 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-wtmp\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-sys\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442590 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-root\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442590 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442290 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-sys\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442590 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442299 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2aca83c4-cff7-4a09-acb1-24f7863732fb-root\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442590 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:06:02.442343 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 00:06:02.442590 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:06:02.442408 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls podName:2aca83c4-cff7-4a09-acb1-24f7863732fb nodeName:}" failed. No retries permitted until 2026-07-28 00:06:02.942390358 +0000 UTC m=+304.606368335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls") pod "node-exporter-hpjpb" (UID: "2aca83c4-cff7-4a09-acb1-24f7863732fb") : secret "node-exporter-tls" not found Jul 28 00:06:02.442854 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442605 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-textfile\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442854 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442836 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.442947 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.442926 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aca83c4-cff7-4a09-acb1-24f7863732fb-metrics-client-ca\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.444610 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.444589 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.462588 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.462553 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jdw\" (UniqueName: \"kubernetes.io/projected/2aca83c4-cff7-4a09-acb1-24f7863732fb-kube-api-access-r5jdw\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.858289 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.858210 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:06:02.945891 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.945857 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:02.945994 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:06:02.945957 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 00:06:02.946054 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:06:02.946028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls podName:2aca83c4-cff7-4a09-acb1-24f7863732fb nodeName:}" failed. No retries permitted until 2026-07-28 00:06:03.946005827 +0000 UTC m=+305.609983804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls") pod "node-exporter-hpjpb" (UID: "2aca83c4-cff7-4a09-acb1-24f7863732fb") : secret "node-exporter-tls" not found Jul 28 00:06:02.980265 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:02.980244 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:06:03.393130 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:03.393097 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:03.769819 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:03.769735 2558 patch_prober.go:28] interesting pod/image-registry-77ddbd6f55-95nmj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 00:06:03.769819 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:03.769793 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" podUID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 00:06:03.859266 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:03.859219 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bh6wr" event={"ID":"07720ded-c51d-4fd1-aa97-a6e66125ec67","Type":"ContainerStarted","Data":"0dd870c6ce61f34b7b9c9f0cb96e15fa45b649ee457c34c9255f06a735aebe86"} Jul 28 00:06:03.953542 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:03.953507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:03.956284 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:03.956259 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2aca83c4-cff7-4a09-acb1-24f7863732fb-node-exporter-tls\") pod \"node-exporter-hpjpb\" (UID: \"2aca83c4-cff7-4a09-acb1-24f7863732fb\") " pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:04.014234 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:04.014199 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hpjpb" Jul 28 00:06:04.026032 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:06:04.026000 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aca83c4_cff7_4a09_acb1_24f7863732fb.slice/crio-24dbe52d693143ce59f1cf6fcf653c27b4d653adcdc5c32ae4b855ed8c30c88e WatchSource:0}: Error finding container 24dbe52d693143ce59f1cf6fcf653c27b4d653adcdc5c32ae4b855ed8c30c88e: Status 404 returned error can't find the container with id 24dbe52d693143ce59f1cf6fcf653c27b4d653adcdc5c32ae4b855ed8c30c88e Jul 28 00:06:04.871472 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:04.871429 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpjpb" event={"ID":"2aca83c4-cff7-4a09-acb1-24f7863732fb","Type":"ContainerStarted","Data":"24dbe52d693143ce59f1cf6fcf653c27b4d653adcdc5c32ae4b855ed8c30c88e"} Jul 28 00:06:04.923860 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:04.923827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:04.989279 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:04.989190 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:05.107412 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:05.107380 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:05.214016 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:05.213938 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:05.529805 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:05.529737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:05.629710 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:05.629675 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:05.783042 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:05.782962 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:06:05.860743 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:05.860713 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:06:06.042998 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.042924 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:06.143252 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.143217 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:06.786005 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.785970 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77ddbd6f55-95nmj"] Jul 28 00:06:06.873505 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.873469 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:06.878989 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.878963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bh6wr" event={"ID":"07720ded-c51d-4fd1-aa97-a6e66125ec67","Type":"ContainerStarted","Data":"d288559e9357d3252f093cbdb423e868c8a51abf96a41cac7a19f2959cc0e559"} Jul 28 00:06:06.880702 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.880677 2558 generic.go:356] "Generic (PLEG): container finished" podID="2aca83c4-cff7-4a09-acb1-24f7863732fb" containerID="fa2e3da13fd62c8a8095ea22e4d20030ae9dbafe3da4743f7341958f93e3e86d" exitCode=0 Jul 28 00:06:06.880787 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.880754 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpjpb" event={"ID":"2aca83c4-cff7-4a09-acb1-24f7863732fb","Type":"ContainerDied","Data":"fa2e3da13fd62c8a8095ea22e4d20030ae9dbafe3da4743f7341958f93e3e86d"} Jul 28 00:06:06.899751 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.899712 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bh6wr" podStartSLOduration=33.277803598 podStartE2EDuration="46.899691315s" totalImagesPullingTime="13.621887717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:05:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:06.898770216 +0000 UTC m=+308.562748216" watchObservedRunningTime="2026-07-28 00:06:06.899691315 +0000 UTC m=+308.563669317" Jul 28 00:06:06.971127 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.971098 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:06.981599 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.981569 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68974cf9c-4q62x"] Jul 28 00:06:06.985764 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.985747 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:06.992255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.992235 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 00:06:06.998106 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:06.998085 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68974cf9c-4q62x"] Jul 28 00:06:07.044736 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.044698 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:07.079881 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.079846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-serving-cert\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.080068 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.079889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-trusted-ca-bundle\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.080068 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.079945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-service-ca\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.080068 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.079987 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-oauth-serving-cert\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.080068 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.080027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-oauth-config\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.080068 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.080050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r8dg\" (UniqueName: \"kubernetes.io/projected/3893fd46-b104-43b5-ac61-66d333db21d0-kube-api-access-6r8dg\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.080229 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.080121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-console-config\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.181400 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.181366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-service-ca\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.181604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.181421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-oauth-serving-cert\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.181604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.181464 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-oauth-config\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.181604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.181486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r8dg\" (UniqueName: \"kubernetes.io/projected/3893fd46-b104-43b5-ac61-66d333db21d0-kube-api-access-6r8dg\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.181604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.181526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-console-config\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.181604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.181557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-serving-cert\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.181604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.181582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-trusted-ca-bundle\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.182265 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.182240 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-service-ca\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.182363 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.182323 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-console-config\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.182423 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.182325 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-oauth-serving-cert\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.182721 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.182701 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-trusted-ca-bundle\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.183870 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.183852 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-oauth-config\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.184052 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.184032 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-serving-cert\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.188815 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.188777 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r8dg\" (UniqueName: \"kubernetes.io/projected/3893fd46-b104-43b5-ac61-66d333db21d0-kube-api-access-6r8dg\") pod \"console-68974cf9c-4q62x\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.235172 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.235134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:07.306647 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.306612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:07.317111 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.317062 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:07.387698 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.386751 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7dbc4985bc-g64qj"] Jul 28 00:06:07.395683 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.391882 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.401685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.396677 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 00:06:07.401685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.396928 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 00:06:07.401685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.397233 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 00:06:07.401685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.397388 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 00:06:07.401685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.397543 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fx4zq\"" Jul 28 00:06:07.401685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.397817 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 00:06:07.403295 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.403271 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 00:06:07.405898 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.405842 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dbc4985bc-g64qj"] Jul 28 00:06:07.459006 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.458796 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68974cf9c-4q62x"] Jul 28 00:06:07.461889 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:06:07.461864 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3893fd46_b104_43b5_ac61_66d333db21d0.slice/crio-30b1b89b65d092b38af8e310628760bc5f059aaf670a19c4814eda11f0512683 WatchSource:0}: Error finding container 30b1b89b65d092b38af8e310628760bc5f059aaf670a19c4814eda11f0512683: Status 404 returned error can't find the container with id 30b1b89b65d092b38af8e310628760bc5f059aaf670a19c4814eda11f0512683 Jul 28 00:06:07.483781 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.483758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-telemeter-client-tls\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.483877 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.483790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.483877 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.483819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-serving-certs-ca-bundle\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.483963 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.483895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.483963 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.483923 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-metrics-client-ca\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.483963 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.483942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-secret-telemeter-client\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.484064 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.483959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-federate-client-tls\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.484064 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.483983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2nl\" (UniqueName: \"kubernetes.io/projected/b07571af-1a8e-40a4-9267-adab88c68a74-kube-api-access-wk2nl\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.585179 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.585148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-serving-certs-ca-bundle\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.585379 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.585192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.585379 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.585217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-metrics-client-ca\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.585379 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.585323 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-secret-telemeter-client\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.585379 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.585345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-federate-client-tls\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.585379 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.585361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2nl\" (UniqueName: \"kubernetes.io/projected/b07571af-1a8e-40a4-9267-adab88c68a74-kube-api-access-wk2nl\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.585644 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.585446 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-telemeter-client-tls\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.585644 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.585478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.586215 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.586163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-metrics-client-ca\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.586330 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.586228 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-serving-certs-ca-bundle\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.586330 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.586233 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b07571af-1a8e-40a4-9267-adab88c68a74-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.588024 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.587976 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-telemeter-client-tls\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.588130 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.588073 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.588252 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.588233 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-secret-telemeter-client\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.588328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.588308 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b07571af-1a8e-40a4-9267-adab88c68a74-federate-client-tls\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.592593 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.592566 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:07.593417 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.593399 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2nl\" (UniqueName: \"kubernetes.io/projected/b07571af-1a8e-40a4-9267-adab88c68a74-kube-api-access-wk2nl\") pod \"telemeter-client-7dbc4985bc-g64qj\" (UID: \"b07571af-1a8e-40a4-9267-adab88c68a74\") " pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.710934 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.710882 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" Jul 28 00:06:07.838260 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.838231 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dbc4985bc-g64qj"] Jul 28 00:06:07.841553 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:06:07.841524 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07571af_1a8e_40a4_9267_adab88c68a74.slice/crio-a0d473f5b5d3f8e8385fe96d02999baeabda3f9a84dd0602797f28733eff7e1f WatchSource:0}: Error finding container a0d473f5b5d3f8e8385fe96d02999baeabda3f9a84dd0602797f28733eff7e1f: Status 404 returned error can't find the container with id a0d473f5b5d3f8e8385fe96d02999baeabda3f9a84dd0602797f28733eff7e1f Jul 28 00:06:07.886571 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.886540 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpjpb" event={"ID":"2aca83c4-cff7-4a09-acb1-24f7863732fb","Type":"ContainerStarted","Data":"b39a58aa9444b791c8164bcb5aacf5b0317275fcc2d542808b0093096402fd3d"} Jul 28 00:06:07.886750 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.886602 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpjpb" event={"ID":"2aca83c4-cff7-4a09-acb1-24f7863732fb","Type":"ContainerStarted","Data":"babebb78b6590cb4d5e8cfea64c4a1a9dbac1bb5f203c7b99acbf2be9a7e4eb7"} Jul 28 00:06:07.887682 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.887639 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" event={"ID":"b07571af-1a8e-40a4-9267-adab88c68a74","Type":"ContainerStarted","Data":"a0d473f5b5d3f8e8385fe96d02999baeabda3f9a84dd0602797f28733eff7e1f"} Jul 28 00:06:07.888991 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.888970 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68974cf9c-4q62x" event={"ID":"3893fd46-b104-43b5-ac61-66d333db21d0","Type":"ContainerStarted","Data":"0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8"} Jul 28 00:06:07.889084 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.889005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68974cf9c-4q62x" event={"ID":"3893fd46-b104-43b5-ac61-66d333db21d0","Type":"ContainerStarted","Data":"30b1b89b65d092b38af8e310628760bc5f059aaf670a19c4814eda11f0512683"} Jul 28 00:06:07.905874 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.905707 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hpjpb" podStartSLOduration=3.191871215 podStartE2EDuration="5.905689019s" totalImagesPullingTime="2.650102694s" totalInitContainerRuntime="63.71511ms" isStatefulPod=true podCreationTimestamp="2026-07-28 00:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:07.904478887 +0000 UTC m=+309.568456886" watchObservedRunningTime="2026-07-28 00:06:07.905689019 +0000 UTC m=+309.569667013" Jul 28 00:06:07.922685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:07.922624 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68974cf9c-4q62x" podStartSLOduration=1.922614602 podStartE2EDuration="1.922614602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:07.921497236 +0000 UTC m=+309.585475234" watchObservedRunningTime="2026-07-28 00:06:07.922614602 +0000 UTC m=+309.586592598" Jul 28 00:06:08.399305 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:08.399267 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:09.897567 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:09.897537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" event={"ID":"b07571af-1a8e-40a4-9267-adab88c68a74","Type":"ContainerStarted","Data":"e91da5ed64a8c4aa8c0ff8da89154715fe28133276dcb7c5aa7d824f0a3c40dd"} Jul 28 00:06:10.903312 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:10.903273 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" event={"ID":"b07571af-1a8e-40a4-9267-adab88c68a74","Type":"ContainerStarted","Data":"146155f3a520bd528a0e5eb88c9ca4497a60588be090b9c04cabbb155b2cc847"} Jul 28 00:06:10.903612 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:10.903336 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" event={"ID":"b07571af-1a8e-40a4-9267-adab88c68a74","Type":"ContainerStarted","Data":"cc25ff420d3d7cccf3d29f16818854dc81e2fda05da069c8250981698dc956b7"} Jul 28 00:06:10.925914 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:10.925878 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7dbc4985bc-g64qj" podStartSLOduration=1.059822297 podStartE2EDuration="3.925864661s" totalImagesPullingTime="2.866042364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:06:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:10.924254309 +0000 UTC m=+312.588232305" watchObservedRunningTime="2026-07-28 00:06:10.925864661 +0000 UTC m=+312.589842658" Jul 28 00:06:12.493480 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.493444 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68974cf9c-4q62x"] Jul 28 00:06:12.526899 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.526873 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-587b5b448d-wwnfz"] Jul 28 00:06:12.530141 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.530126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.540893 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.540874 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-587b5b448d-wwnfz"] Jul 28 00:06:12.627151 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.627128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-trusted-ca-bundle\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.627257 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.627174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-config\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.627257 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.627203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-oauth-config\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.627257 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.627220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-oauth-serving-cert\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.627360 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.627272 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd6t5\" (UniqueName: \"kubernetes.io/projected/2bbcffb7-c871-461d-a24f-00a89e6ca1af-kube-api-access-xd6t5\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.627360 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.627313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-serving-cert\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.627360 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.627346 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-service-ca\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.728416 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.728380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-service-ca\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.728416 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.728421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-trusted-ca-bundle\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.728741 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.728630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-config\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.728741 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.728710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-oauth-config\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.728741 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.728738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-oauth-serving-cert\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.728885 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.728790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd6t5\" (UniqueName: \"kubernetes.io/projected/2bbcffb7-c871-461d-a24f-00a89e6ca1af-kube-api-access-xd6t5\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.728885 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.728830 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-serving-cert\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.729378 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.729320 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-service-ca\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.729484 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.729375 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-trusted-ca-bundle\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.729484 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.729383 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-config\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.729484 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.729404 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-oauth-serving-cert\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.731052 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.731032 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-serving-cert\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.731145 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.731083 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-oauth-config\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.736035 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.736011 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd6t5\" (UniqueName: \"kubernetes.io/projected/2bbcffb7-c871-461d-a24f-00a89e6ca1af-kube-api-access-xd6t5\") pod \"console-587b5b448d-wwnfz\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.838913 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.838844 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:12.969412 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:12.969379 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-587b5b448d-wwnfz"] Jul 28 00:06:12.973405 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:06:12.973381 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbcffb7_c871_461d_a24f_00a89e6ca1af.slice/crio-b705f5715a68857148b442aedd5e2efaa317447cade79807c8e8b793a4601cac WatchSource:0}: Error finding container b705f5715a68857148b442aedd5e2efaa317447cade79807c8e8b793a4601cac: Status 404 returned error can't find the container with id b705f5715a68857148b442aedd5e2efaa317447cade79807c8e8b793a4601cac Jul 28 00:06:13.917588 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:13.917554 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-587b5b448d-wwnfz" event={"ID":"2bbcffb7-c871-461d-a24f-00a89e6ca1af","Type":"ContainerStarted","Data":"149e59fafbf4eabe0326b9fdbd9c71714e1a9ff9c41933563bfd8469c87d1161"} Jul 28 00:06:13.917971 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:13.917602 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-587b5b448d-wwnfz" event={"ID":"2bbcffb7-c871-461d-a24f-00a89e6ca1af","Type":"ContainerStarted","Data":"b705f5715a68857148b442aedd5e2efaa317447cade79807c8e8b793a4601cac"} Jul 28 00:06:13.938088 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:13.938043 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-587b5b448d-wwnfz" podStartSLOduration=1.9380277879999999 podStartE2EDuration="1.938027788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:06:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:13.936843594 +0000 UTC m=+315.600821592" watchObservedRunningTime="2026-07-28 00:06:13.938027788 +0000 UTC m=+315.602006164" Jul 28 00:06:14.931005 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:14.930958 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:15.030149 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:15.030117 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:15.721810 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:15.721782 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:15.778228 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:15.778195 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:17.307577 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:17.307544 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:17.719040 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:17.719004 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:17.798756 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:17.798722 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:18.033323 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:18.033250 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:18.133541 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:18.133510 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:19.156806 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:19.156770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:19.215404 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:19.215367 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:19.816417 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:19.816381 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:19.917895 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:19.917867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:22.839116 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:22.839080 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:22.839506 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:22.839141 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:22.844069 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:22.844021 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:22.957102 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:22.957071 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:06:23.003835 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:23.003812 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfdd7dd66-sc42b"] Jul 28 00:06:23.114604 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:23.114531 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:23.215832 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:23.215797 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:23.316425 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:23.316348 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:23.967312 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:23.967258 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:25.965791 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:25.965756 2558 generic.go:356] "Generic (PLEG): container finished" podID="6fdd80f7-e31b-4a9c-a6de-d6061d1bd935" containerID="1dcb42dcd611aba880778554453e7ffceddda026216668c763d427f14fb11a7a" exitCode=0 Jul 28 00:06:25.966152 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:25.965832 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" event={"ID":"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935","Type":"ContainerDied","Data":"1dcb42dcd611aba880778554453e7ffceddda026216668c763d427f14fb11a7a"} Jul 28 00:06:25.966152 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:25.966128 2558 scope.go:117] "RemoveContainer" containerID="1dcb42dcd611aba880778554453e7ffceddda026216668c763d427f14fb11a7a" Jul 28 00:06:25.993216 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:25.993190 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:26.064863 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:26.064831 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:26.971121 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:26.971092 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-c6666" event={"ID":"6fdd80f7-e31b-4a9c-a6de-d6061d1bd935","Type":"ContainerStarted","Data":"1e19531ef4623385edd274e693564213226332cf59380e69b098cca4a9d00602"} Jul 28 00:06:29.124929 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:29.124893 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:29.176090 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:29.176055 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:31.604007 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:31.603970 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:31.701704 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:31.701659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:31.810140 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:31.810106 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" podUID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" containerName="registry" containerID="cri-o://8299709fdf5ea61e7e8ac413fdb65e2dc5ac9bab0df902085dd288ceef37b94b" gracePeriod=30 Jul 28 00:06:31.991097 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:31.991070 2558 generic.go:356] "Generic (PLEG): container finished" podID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" containerID="8299709fdf5ea61e7e8ac413fdb65e2dc5ac9bab0df902085dd288ceef37b94b" exitCode=0 Jul 28 00:06:31.991246 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:31.991148 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" event={"ID":"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4","Type":"ContainerDied","Data":"8299709fdf5ea61e7e8ac413fdb65e2dc5ac9bab0df902085dd288ceef37b94b"} Jul 28 00:06:32.044154 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.044126 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:06:32.191941 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.191867 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-image-registry-private-configuration\") pod \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " Jul 28 00:06:32.191941 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.191924 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-installation-pull-secrets\") pod \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " Jul 28 00:06:32.192126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.191958 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-trusted-ca\") pod \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " Jul 28 00:06:32.192126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.192025 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") pod \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " Jul 28 00:06:32.192126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.192053 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-certificates\") pod \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " Jul 28 00:06:32.192126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.192081 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-bound-sa-token\") pod \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " Jul 28 00:06:32.192126 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.192107 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn2st\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-kube-api-access-xn2st\") pod \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " Jul 28 00:06:32.192356 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.192135 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-ca-trust-extracted\") pod \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\" (UID: \"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4\") " Jul 28 00:06:32.192448 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.192422 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:32.192597 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.192547 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:32.194326 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.194294 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:06:32.194528 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.194498 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:06:32.194645 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.194535 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:06:32.194645 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.194583 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:06:32.194802 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.194718 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-kube-api-access-xn2st" (OuterVolumeSpecName: "kube-api-access-xn2st") pod "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4"). InnerVolumeSpecName "kube-api-access-xn2st". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:06:32.200409 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.200385 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" (UID: "fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:06:32.293319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.293265 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-installation-pull-secrets\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:32.293319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.293311 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-trusted-ca\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:32.293319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.293321 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-tls\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:32.293319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.293330 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-registry-certificates\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:32.293319 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.293339 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-bound-sa-token\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:32.293605 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.293348 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn2st\" (UniqueName: \"kubernetes.io/projected/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-kube-api-access-xn2st\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:32.293605 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.293356 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-ca-trust-extracted\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:32.293605 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.293365 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4-image-registry-private-configuration\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:32.995977 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.995937 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" event={"ID":"fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4","Type":"ContainerDied","Data":"ace4c5a6e8731acca3d131d9fee008104b9ba8b3f9f425cb9ee8d71b661f34fb"} Jul 28 00:06:32.996367 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.996000 2558 scope.go:117] "RemoveContainer" containerID="8299709fdf5ea61e7e8ac413fdb65e2dc5ac9bab0df902085dd288ceef37b94b" Jul 28 00:06:32.996367 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:32.995948 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77ddbd6f55-95nmj" Jul 28 00:06:33.010995 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:33.010970 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77ddbd6f55-95nmj"] Jul 28 00:06:33.014909 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:33.014890 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77ddbd6f55-95nmj"] Jul 28 00:06:34.870110 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:34.870079 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" path="/var/lib/kubelet/pods/fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4/volumes" Jul 28 00:06:35.886074 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:35.886041 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:35.981542 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:35.981501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:37.512501 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.512463 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68974cf9c-4q62x" podUID="3893fd46-b104-43b5-ac61-66d333db21d0" containerName="console" containerID="cri-o://0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8" gracePeriod=15 Jul 28 00:06:37.799627 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.799574 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:37.941295 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941272 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-trusted-ca-bundle\") pod \"3893fd46-b104-43b5-ac61-66d333db21d0\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " Jul 28 00:06:37.941431 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941305 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-service-ca\") pod \"3893fd46-b104-43b5-ac61-66d333db21d0\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " Jul 28 00:06:37.941431 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941326 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-serving-cert\") pod \"3893fd46-b104-43b5-ac61-66d333db21d0\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " Jul 28 00:06:37.941431 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941350 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-oauth-config\") pod \"3893fd46-b104-43b5-ac61-66d333db21d0\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " Jul 28 00:06:37.941583 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941484 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-console-config\") pod \"3893fd46-b104-43b5-ac61-66d333db21d0\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " Jul 28 00:06:37.941583 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941560 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-oauth-serving-cert\") pod \"3893fd46-b104-43b5-ac61-66d333db21d0\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " Jul 28 00:06:37.941697 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941594 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r8dg\" (UniqueName: \"kubernetes.io/projected/3893fd46-b104-43b5-ac61-66d333db21d0-kube-api-access-6r8dg\") pod \"3893fd46-b104-43b5-ac61-66d333db21d0\" (UID: \"3893fd46-b104-43b5-ac61-66d333db21d0\") " Jul 28 00:06:37.941697 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941634 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3893fd46-b104-43b5-ac61-66d333db21d0" (UID: "3893fd46-b104-43b5-ac61-66d333db21d0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:37.941874 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941849 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-trusted-ca-bundle\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:37.941874 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941859 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-console-config" (OuterVolumeSpecName: "console-config") pod "3893fd46-b104-43b5-ac61-66d333db21d0" (UID: "3893fd46-b104-43b5-ac61-66d333db21d0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:37.942040 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.941936 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3893fd46-b104-43b5-ac61-66d333db21d0" (UID: "3893fd46-b104-43b5-ac61-66d333db21d0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:37.942182 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.942162 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-service-ca" (OuterVolumeSpecName: "service-ca") pod "3893fd46-b104-43b5-ac61-66d333db21d0" (UID: "3893fd46-b104-43b5-ac61-66d333db21d0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:37.943592 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.943566 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3893fd46-b104-43b5-ac61-66d333db21d0" (UID: "3893fd46-b104-43b5-ac61-66d333db21d0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:06:37.943696 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.943587 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3893fd46-b104-43b5-ac61-66d333db21d0" (UID: "3893fd46-b104-43b5-ac61-66d333db21d0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:06:37.943696 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:37.943682 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3893fd46-b104-43b5-ac61-66d333db21d0-kube-api-access-6r8dg" (OuterVolumeSpecName: "kube-api-access-6r8dg") pod "3893fd46-b104-43b5-ac61-66d333db21d0" (UID: "3893fd46-b104-43b5-ac61-66d333db21d0"). InnerVolumeSpecName "kube-api-access-6r8dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:06:38.016258 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.016233 2558 generic.go:356] "Generic (PLEG): container finished" podID="3893fd46-b104-43b5-ac61-66d333db21d0" containerID="0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8" exitCode=0 Jul 28 00:06:38.016348 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.016277 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68974cf9c-4q62x" Jul 28 00:06:38.016348 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.016316 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68974cf9c-4q62x" event={"ID":"3893fd46-b104-43b5-ac61-66d333db21d0","Type":"ContainerDied","Data":"0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8"} Jul 28 00:06:38.016420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.016369 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68974cf9c-4q62x" event={"ID":"3893fd46-b104-43b5-ac61-66d333db21d0","Type":"ContainerDied","Data":"30b1b89b65d092b38af8e310628760bc5f059aaf670a19c4814eda11f0512683"} Jul 28 00:06:38.016420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.016389 2558 scope.go:117] "RemoveContainer" containerID="0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8" Jul 28 00:06:38.025774 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.025761 2558 scope.go:117] "RemoveContainer" containerID="0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8" Jul 28 00:06:38.026026 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:06:38.026008 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8\": container with ID starting with 0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8 not found: ID does not exist" containerID="0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8" Jul 28 00:06:38.026076 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.026038 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8"} err="failed to get container status \"0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8\": rpc error: code = NotFound desc = could not find container \"0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8\": container with ID starting with 0407fac3d9113265a49190f36a9531398a1c2cd1b89c45f4b95a619cdad767d8 not found: ID does not exist" Jul 28 00:06:38.037851 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.037832 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68974cf9c-4q62x"] Jul 28 00:06:38.042236 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.042217 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-oauth-serving-cert\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:38.042314 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.042239 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r8dg\" (UniqueName: \"kubernetes.io/projected/3893fd46-b104-43b5-ac61-66d333db21d0-kube-api-access-6r8dg\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:38.042314 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.042249 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-service-ca\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:38.042314 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.042257 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-serving-cert\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:38.042314 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.042288 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3893fd46-b104-43b5-ac61-66d333db21d0-console-oauth-config\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:38.042314 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.042296 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3893fd46-b104-43b5-ac61-66d333db21d0-console-config\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:38.042314 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.042222 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68974cf9c-4q62x"] Jul 28 00:06:38.865076 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:38.865038 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3893fd46-b104-43b5-ac61-66d333db21d0" path="/var/lib/kubelet/pods/3893fd46-b104-43b5-ac61-66d333db21d0/volumes" Jul 28 00:06:44.074825 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:44.074793 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:44.136272 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:44.136243 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:48.022599 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.022525 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cfdd7dd66-sc42b" podUID="e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" containerName="console" containerID="cri-o://7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0" gracePeriod=15 Jul 28 00:06:48.261857 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.261834 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:06:48.313153 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313099 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-oauth-config\") pod \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " Jul 28 00:06:48.313255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313158 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-service-ca\") pod \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " Jul 28 00:06:48.313255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313178 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-config\") pod \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " Jul 28 00:06:48.313255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313212 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-serving-cert\") pod \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " Jul 28 00:06:48.313255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313233 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fts5g\" (UniqueName: \"kubernetes.io/projected/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-kube-api-access-fts5g\") pod \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " Jul 28 00:06:48.313255 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313248 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-oauth-serving-cert\") pod \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\" (UID: \"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5\") " Jul 28 00:06:48.313659 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313624 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" (UID: "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:48.313802 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313637 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-config" (OuterVolumeSpecName: "console-config") pod "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" (UID: "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:48.313802 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.313722 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" (UID: "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:48.315157 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.315131 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" (UID: "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:06:48.315248 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.315168 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" (UID: "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:06:48.315248 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.315179 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-kube-api-access-fts5g" (OuterVolumeSpecName: "kube-api-access-fts5g") pod "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" (UID: "e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5"). InnerVolumeSpecName "kube-api-access-fts5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:06:48.414260 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.414237 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-serving-cert\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:48.414260 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.414257 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fts5g\" (UniqueName: \"kubernetes.io/projected/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-kube-api-access-fts5g\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:48.414372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.414266 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-oauth-serving-cert\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:48.414372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.414275 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-oauth-config\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:48.414372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.414284 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-service-ca\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:48.414372 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.414292 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5-console-config\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:06:48.644762 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:48.644712 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:49.060525 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.060458 2558 generic.go:356] "Generic (PLEG): container finished" podID="e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" containerID="7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0" exitCode=0 Jul 28 00:06:49.060525 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.060505 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfdd7dd66-sc42b" Jul 28 00:06:49.060980 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.060537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfdd7dd66-sc42b" event={"ID":"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5","Type":"ContainerDied","Data":"7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0"} Jul 28 00:06:49.060980 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.060593 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfdd7dd66-sc42b" event={"ID":"e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5","Type":"ContainerDied","Data":"a1e50cc9d7ce2739ba4e81558f2b16d6450f222cce0cf21a25d8aadd45f9852f"} Jul 28 00:06:49.060980 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.060627 2558 scope.go:117] "RemoveContainer" containerID="7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0" Jul 28 00:06:49.069070 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.069033 2558 scope.go:117] "RemoveContainer" containerID="7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0" Jul 28 00:06:49.069323 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:06:49.069303 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0\": container with ID starting with 7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0 not found: ID does not exist" containerID="7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0" Jul 28 00:06:49.069390 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.069328 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0"} err="failed to get container status \"7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0\": rpc error: code = NotFound desc = could not find container \"7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0\": container with ID starting with 7ff0546811693a6d64078fb02fa5f635e4972123f66b2eddbd9658610138b6b0 not found: ID does not exist" Jul 28 00:06:49.074752 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.074728 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfdd7dd66-sc42b"] Jul 28 00:06:49.076769 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.076748 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cfdd7dd66-sc42b"] Jul 28 00:06:49.861094 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.861055 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:49.959746 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:49.959714 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:50.866541 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:50.866462 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" path="/var/lib/kubelet/pods/e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5/volumes" Jul 28 00:06:55.598108 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:55.598073 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:06:55.655811 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:06:55.655785 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:12.678568 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:12.678514 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:07:12.684801 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:12.684781 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f0d0fd9-0703-4cb3-ab02-11dce13801a3-metrics-certs\") pod \"network-metrics-daemon-dtwj5\" (UID: \"3f0d0fd9-0703-4cb3-ab02-11dce13801a3\") " pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:07:12.764328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:12.764300 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-shf5w\"" Jul 28 00:07:12.772887 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:12.772867 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtwj5" Jul 28 00:07:12.900637 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:12.900610 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtwj5"] Jul 28 00:07:12.905155 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:07:12.905131 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0d0fd9_0703_4cb3_ab02_11dce13801a3.slice/crio-2bba944c62ada3d50487d8ec417d0d8e8b65894acb72ce1fb14f8f714e6596f7 WatchSource:0}: Error finding container 2bba944c62ada3d50487d8ec417d0d8e8b65894acb72ce1fb14f8f714e6596f7: Status 404 returned error can't find the container with id 2bba944c62ada3d50487d8ec417d0d8e8b65894acb72ce1fb14f8f714e6596f7 Jul 28 00:07:13.148015 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:13.147984 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtwj5" event={"ID":"3f0d0fd9-0703-4cb3-ab02-11dce13801a3","Type":"ContainerStarted","Data":"2bba944c62ada3d50487d8ec417d0d8e8b65894acb72ce1fb14f8f714e6596f7"} Jul 28 00:07:14.153434 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:14.153402 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtwj5" event={"ID":"3f0d0fd9-0703-4cb3-ab02-11dce13801a3","Type":"ContainerStarted","Data":"52f4f548c9e5af1cbf8b4280ef3ea6ea47f7e56ee88d824bbb1dc5b6e54764b1"} Jul 28 00:07:14.153923 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:14.153454 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtwj5" event={"ID":"3f0d0fd9-0703-4cb3-ab02-11dce13801a3","Type":"ContainerStarted","Data":"302697c0306594ac0617fe9d65e5d6f73452d9c3056ffa4cd1f74d0afd58e8b2"} Jul 28 00:07:14.168428 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:14.168379 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dtwj5" podStartSLOduration=374.323126441 podStartE2EDuration="6m15.168364388s" totalImagesPullingTime="845.237947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:07:14.167579535 +0000 UTC m=+375.831557532" watchObservedRunningTime="2026-07-28 00:07:14.168364388 +0000 UTC m=+375.832342385" Jul 28 00:07:14.261039 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:14.261014 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:14.361677 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:14.361638 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:18.279830 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:18.279793 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:18.334275 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:18.334242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:22.394697 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:22.394647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:22.495853 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:22.495803 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:23.921702 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:23.921648 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:24.038356 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:24.038316 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:30.287455 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:30.287417 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:30.363458 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:30.363421 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:34.834494 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:34.834449 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:34.935242 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:34.935207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:38.027068 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027033 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7455645f64-nfgjj"] Jul 28 00:07:38.027534 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027431 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" containerName="console" Jul 28 00:07:38.027534 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027453 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" containerName="console" Jul 28 00:07:38.027534 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027474 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" containerName="registry" Jul 28 00:07:38.027534 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027482 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" containerName="registry" Jul 28 00:07:38.027534 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027493 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3893fd46-b104-43b5-ac61-66d333db21d0" containerName="console" Jul 28 00:07:38.027534 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027500 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3893fd46-b104-43b5-ac61-66d333db21d0" containerName="console" Jul 28 00:07:38.027842 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027568 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3893fd46-b104-43b5-ac61-66d333db21d0" containerName="console" Jul 28 00:07:38.027842 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027581 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8fcf1b5-a5a4-42f4-8c18-987ac0889ff5" containerName="console" Jul 28 00:07:38.027842 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.027592 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8236cf-4ab7-4cc0-9b19-1d65c9b850b4" containerName="registry" Jul 28 00:07:38.031058 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.031037 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.044311 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.044285 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7455645f64-nfgjj"] Jul 28 00:07:38.096910 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.096888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:38.149706 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.149661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-serving-cert\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.149792 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.149718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-service-ca\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.149792 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.149764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-oauth-config\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.149862 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.149792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-config\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.149862 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.149824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-oauth-serving-cert\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.149862 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.149844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk4zs\" (UniqueName: \"kubernetes.io/projected/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-kube-api-access-tk4zs\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.149945 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.149874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-trusted-ca-bundle\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.250800 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.250773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-oauth-config\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.250888 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.250801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-config\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.250888 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.250819 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-oauth-serving-cert\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.250888 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.250843 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk4zs\" (UniqueName: \"kubernetes.io/projected/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-kube-api-access-tk4zs\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.251037 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.250893 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-trusted-ca-bundle\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.251037 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.250920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-serving-cert\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.251037 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.250963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-service-ca\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.251619 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.251594 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-config\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.251732 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.251630 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-oauth-serving-cert\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.251732 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.251705 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-service-ca\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.251914 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.251749 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-trusted-ca-bundle\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.253334 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.253308 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-oauth-config\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.253554 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.253530 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-serving-cert\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.258957 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.258936 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk4zs\" (UniqueName: \"kubernetes.io/projected/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-kube-api-access-tk4zs\") pod \"console-7455645f64-nfgjj\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.339814 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.339766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:38.474992 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:38.474961 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7455645f64-nfgjj"] Jul 28 00:07:38.478219 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:07:38.478199 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b6ab96_ed8e_4ee4_ace4_c70f5eee2712.slice/crio-852b5d37b43e2d8b188f86d92bb3359c3cacba26f5315a4f2d89a8d17582a296 WatchSource:0}: Error finding container 852b5d37b43e2d8b188f86d92bb3359c3cacba26f5315a4f2d89a8d17582a296: Status 404 returned error can't find the container with id 852b5d37b43e2d8b188f86d92bb3359c3cacba26f5315a4f2d89a8d17582a296 Jul 28 00:07:39.246178 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:39.246139 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7455645f64-nfgjj" event={"ID":"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712","Type":"ContainerStarted","Data":"1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df"} Jul 28 00:07:39.246598 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:39.246196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7455645f64-nfgjj" event={"ID":"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712","Type":"ContainerStarted","Data":"852b5d37b43e2d8b188f86d92bb3359c3cacba26f5315a4f2d89a8d17582a296"} Jul 28 00:07:39.263983 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:39.263929 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7455645f64-nfgjj" podStartSLOduration=1.263911815 podStartE2EDuration="1.263911815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:07:39.262546898 +0000 UTC m=+400.926524895" watchObservedRunningTime="2026-07-28 00:07:39.263911815 +0000 UTC m=+400.927889896" Jul 28 00:07:48.340150 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:48.340119 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:48.340595 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:48.340209 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:48.344619 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:48.344600 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:49.288799 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:49.288772 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:07:49.341145 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:49.341115 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-587b5b448d-wwnfz"] Jul 28 00:07:49.487845 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:49.487817 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:49.588849 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:49.588780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:07:49.652196 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:07:49.652163 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:00.974900 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:00.974858 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:01.094728 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:01.094694 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:08.217186 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:08.217146 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:08.310006 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:08.309969 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:09.038576 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.038541 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh"] Jul 28 00:08:09.041799 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.041783 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.044064 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.044042 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dwlvz\"" Jul 28 00:08:09.044332 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.044314 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 00:08:09.044616 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.044600 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 00:08:09.051451 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.051425 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh"] Jul 28 00:08:09.170084 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.170048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.170245 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.170148 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.170245 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.170180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdwgf\" (UniqueName: \"kubernetes.io/projected/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-kube-api-access-cdwgf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.271130 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.271099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.271130 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.271134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdwgf\" (UniqueName: \"kubernetes.io/projected/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-kube-api-access-cdwgf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.271513 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.271155 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.271558 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.271518 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.271558 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.271526 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.281595 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.281572 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdwgf\" (UniqueName: \"kubernetes.io/projected/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-kube-api-access-cdwgf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.350466 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.350394 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:09.474522 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:09.474345 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh"] Jul 28 00:08:09.477194 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:08:09.477156 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b4f4b6_2c88_424e_9fc1_573ea5265ec3.slice/crio-e7b996c029f0d0b7c168b8b2f8fc8ec40855f6ea800ddf536b7ecdc0c173cf71 WatchSource:0}: Error finding container e7b996c029f0d0b7c168b8b2f8fc8ec40855f6ea800ddf536b7ecdc0c173cf71: Status 404 returned error can't find the container with id e7b996c029f0d0b7c168b8b2f8fc8ec40855f6ea800ddf536b7ecdc0c173cf71 Jul 28 00:08:10.363739 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:10.363693 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" event={"ID":"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3","Type":"ContainerStarted","Data":"e7b996c029f0d0b7c168b8b2f8fc8ec40855f6ea800ddf536b7ecdc0c173cf71"} Jul 28 00:08:14.360224 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:14.360174 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-587b5b448d-wwnfz" podUID="2bbcffb7-c871-461d-a24f-00a89e6ca1af" containerName="console" containerID="cri-o://149e59fafbf4eabe0326b9fdbd9c71714e1a9ff9c41933563bfd8469c87d1161" gracePeriod=15 Jul 28 00:08:15.383696 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.383642 2558 generic.go:356] "Generic (PLEG): container finished" podID="2bbcffb7-c871-461d-a24f-00a89e6ca1af" containerID="149e59fafbf4eabe0326b9fdbd9c71714e1a9ff9c41933563bfd8469c87d1161" exitCode=0 Jul 28 00:08:15.384027 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.383708 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-587b5b448d-wwnfz" event={"ID":"2bbcffb7-c871-461d-a24f-00a89e6ca1af","Type":"ContainerDied","Data":"149e59fafbf4eabe0326b9fdbd9c71714e1a9ff9c41933563bfd8469c87d1161"} Jul 28 00:08:15.505861 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.505838 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:08:15.625521 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.625494 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-oauth-serving-cert\") pod \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " Jul 28 00:08:15.625694 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.625528 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd6t5\" (UniqueName: \"kubernetes.io/projected/2bbcffb7-c871-461d-a24f-00a89e6ca1af-kube-api-access-xd6t5\") pod \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " Jul 28 00:08:15.625694 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.625569 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-serving-cert\") pod \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " Jul 28 00:08:15.625694 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.625587 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-oauth-config\") pod \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " Jul 28 00:08:15.625694 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.625614 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-service-ca\") pod \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " Jul 28 00:08:15.625694 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.625685 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-trusted-ca-bundle\") pod \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " Jul 28 00:08:15.625934 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.625708 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-config\") pod \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\" (UID: \"2bbcffb7-c871-461d-a24f-00a89e6ca1af\") " Jul 28 00:08:15.626036 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.626006 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2bbcffb7-c871-461d-a24f-00a89e6ca1af" (UID: "2bbcffb7-c871-461d-a24f-00a89e6ca1af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:08:15.626102 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.626075 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-service-ca" (OuterVolumeSpecName: "service-ca") pod "2bbcffb7-c871-461d-a24f-00a89e6ca1af" (UID: "2bbcffb7-c871-461d-a24f-00a89e6ca1af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:08:15.626146 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.626103 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-config" (OuterVolumeSpecName: "console-config") pod "2bbcffb7-c871-461d-a24f-00a89e6ca1af" (UID: "2bbcffb7-c871-461d-a24f-00a89e6ca1af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:08:15.626146 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.626116 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2bbcffb7-c871-461d-a24f-00a89e6ca1af" (UID: "2bbcffb7-c871-461d-a24f-00a89e6ca1af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:08:15.627780 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.627756 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2bbcffb7-c871-461d-a24f-00a89e6ca1af" (UID: "2bbcffb7-c871-461d-a24f-00a89e6ca1af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:08:15.627878 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.627785 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2bbcffb7-c871-461d-a24f-00a89e6ca1af" (UID: "2bbcffb7-c871-461d-a24f-00a89e6ca1af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:08:15.627878 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.627799 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bbcffb7-c871-461d-a24f-00a89e6ca1af-kube-api-access-xd6t5" (OuterVolumeSpecName: "kube-api-access-xd6t5") pod "2bbcffb7-c871-461d-a24f-00a89e6ca1af" (UID: "2bbcffb7-c871-461d-a24f-00a89e6ca1af"). InnerVolumeSpecName "kube-api-access-xd6t5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:08:15.727161 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.727115 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd6t5\" (UniqueName: \"kubernetes.io/projected/2bbcffb7-c871-461d-a24f-00a89e6ca1af-kube-api-access-xd6t5\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:15.727161 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.727154 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-serving-cert\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:15.727161 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.727165 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-oauth-config\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:15.727161 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.727173 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-service-ca\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:15.727402 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.727182 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-trusted-ca-bundle\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:15.727402 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.727190 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-console-config\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:15.727402 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:15.727199 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bbcffb7-c871-461d-a24f-00a89e6ca1af-oauth-serving-cert\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:16.387998 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:16.387968 2558 generic.go:356] "Generic (PLEG): container finished" podID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerID="c491fc1c54b24aa03469d475999866ee0b6ed3503460689e3521d0fa2eaa53cb" exitCode=0 Jul 28 00:08:16.388391 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:16.388051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" event={"ID":"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3","Type":"ContainerDied","Data":"c491fc1c54b24aa03469d475999866ee0b6ed3503460689e3521d0fa2eaa53cb"} Jul 28 00:08:16.394803 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:16.394715 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-587b5b448d-wwnfz" event={"ID":"2bbcffb7-c871-461d-a24f-00a89e6ca1af","Type":"ContainerDied","Data":"b705f5715a68857148b442aedd5e2efaa317447cade79807c8e8b793a4601cac"} Jul 28 00:08:16.394803 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:16.394776 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-587b5b448d-wwnfz" Jul 28 00:08:16.394803 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:16.394799 2558 scope.go:117] "RemoveContainer" containerID="149e59fafbf4eabe0326b9fdbd9c71714e1a9ff9c41933563bfd8469c87d1161" Jul 28 00:08:16.422722 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:16.422697 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-587b5b448d-wwnfz"] Jul 28 00:08:16.429102 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:16.429082 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-587b5b448d-wwnfz"] Jul 28 00:08:16.865928 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:16.865899 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bbcffb7-c871-461d-a24f-00a89e6ca1af" path="/var/lib/kubelet/pods/2bbcffb7-c871-461d-a24f-00a89e6ca1af/volumes" Jul 28 00:08:19.409512 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:19.409479 2558 generic.go:356] "Generic (PLEG): container finished" podID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerID="63a3fba52f2b4cf4547b0bf4240ed1a77afd4fcca236570c35017e54367b25bd" exitCode=0 Jul 28 00:08:19.409964 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:19.409521 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" event={"ID":"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3","Type":"ContainerDied","Data":"63a3fba52f2b4cf4547b0bf4240ed1a77afd4fcca236570c35017e54367b25bd"} Jul 28 00:08:27.443491 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:27.443460 2558 generic.go:356] "Generic (PLEG): container finished" podID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerID="e466b0f953f05254e1b9bc9749a7e375e48d50dd5b19b1b41c0dba36947698ab" exitCode=0 Jul 28 00:08:27.443898 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:27.443544 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" event={"ID":"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3","Type":"ContainerDied","Data":"e466b0f953f05254e1b9bc9749a7e375e48d50dd5b19b1b41c0dba36947698ab"} Jul 28 00:08:27.545528 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:27.545503 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:27.605889 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:27.605867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:28.585869 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.585845 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:28.626728 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.626703 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-bundle\") pod \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " Jul 28 00:08:28.626847 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.626771 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-util\") pod \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " Jul 28 00:08:28.626847 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.626818 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdwgf\" (UniqueName: \"kubernetes.io/projected/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-kube-api-access-cdwgf\") pod \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\" (UID: \"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3\") " Jul 28 00:08:28.627384 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.627358 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-bundle" (OuterVolumeSpecName: "bundle") pod "d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" (UID: "d0b4f4b6-2c88-424e-9fc1-573ea5265ec3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:08:28.628881 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.628853 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-kube-api-access-cdwgf" (OuterVolumeSpecName: "kube-api-access-cdwgf") pod "d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" (UID: "d0b4f4b6-2c88-424e-9fc1-573ea5265ec3"). InnerVolumeSpecName "kube-api-access-cdwgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:08:28.630873 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.630853 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-util" (OuterVolumeSpecName: "util") pod "d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" (UID: "d0b4f4b6-2c88-424e-9fc1-573ea5265ec3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:08:28.727420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.727374 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-util\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:28.727420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.727396 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdwgf\" (UniqueName: \"kubernetes.io/projected/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-kube-api-access-cdwgf\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:28.727420 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:28.727405 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0b4f4b6-2c88-424e-9fc1-573ea5265ec3-bundle\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:08:29.452035 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:29.452000 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" event={"ID":"d0b4f4b6-2c88-424e-9fc1-573ea5265ec3","Type":"ContainerDied","Data":"e7b996c029f0d0b7c168b8b2f8fc8ec40855f6ea800ddf536b7ecdc0c173cf71"} Jul 28 00:08:29.452194 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:29.452069 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7b996c029f0d0b7c168b8b2f8fc8ec40855f6ea800ddf536b7ecdc0c173cf71" Jul 28 00:08:29.452194 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:29.452015 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t4rrh" Jul 28 00:08:35.356063 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:35.356021 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:36.760899 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:36.760849 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:37.242918 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.242890 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt"] Jul 28 00:08:37.243153 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243140 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerName="extract" Jul 28 00:08:37.243199 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243154 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerName="extract" Jul 28 00:08:37.243199 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243163 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerName="util" Jul 28 00:08:37.243199 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243168 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerName="util" Jul 28 00:08:37.243199 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243182 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbcffb7-c871-461d-a24f-00a89e6ca1af" containerName="console" Jul 28 00:08:37.243199 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243187 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbcffb7-c871-461d-a24f-00a89e6ca1af" containerName="console" Jul 28 00:08:37.243199 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243197 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerName="pull" Jul 28 00:08:37.243385 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243202 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerName="pull" Jul 28 00:08:37.243385 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243245 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbcffb7-c871-461d-a24f-00a89e6ca1af" containerName="console" Jul 28 00:08:37.243385 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.243252 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b4f4b6-2c88-424e-9fc1-573ea5265ec3" containerName="extract" Jul 28 00:08:37.246401 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.246381 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" Jul 28 00:08:37.248591 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.248569 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 28 00:08:37.248990 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.248974 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nm5bp\"" Jul 28 00:08:37.249150 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.249137 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:08:37.277822 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.277799 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt"] Jul 28 00:08:37.285894 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.285877 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4255e938-868c-4224-8b74-d7afcc441442-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gnzjt\" (UID: \"4255e938-868c-4224-8b74-d7afcc441442\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" Jul 28 00:08:37.285969 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.285912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5t7p\" (UniqueName: \"kubernetes.io/projected/4255e938-868c-4224-8b74-d7afcc441442-kube-api-access-r5t7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-gnzjt\" (UID: \"4255e938-868c-4224-8b74-d7afcc441442\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" Jul 28 00:08:37.387120 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.387090 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4255e938-868c-4224-8b74-d7afcc441442-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gnzjt\" (UID: \"4255e938-868c-4224-8b74-d7afcc441442\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" Jul 28 00:08:37.387220 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.387145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5t7p\" (UniqueName: \"kubernetes.io/projected/4255e938-868c-4224-8b74-d7afcc441442-kube-api-access-r5t7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-gnzjt\" (UID: \"4255e938-868c-4224-8b74-d7afcc441442\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" Jul 28 00:08:37.387469 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.387450 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4255e938-868c-4224-8b74-d7afcc441442-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gnzjt\" (UID: \"4255e938-868c-4224-8b74-d7afcc441442\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" Jul 28 00:08:37.397806 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.397787 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5t7p\" (UniqueName: \"kubernetes.io/projected/4255e938-868c-4224-8b74-d7afcc441442-kube-api-access-r5t7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-gnzjt\" (UID: \"4255e938-868c-4224-8b74-d7afcc441442\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" Jul 28 00:08:37.554920 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.554864 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" Jul 28 00:08:37.686776 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:37.686751 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt"] Jul 28 00:08:37.689679 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:08:37.689646 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4255e938_868c_4224_8b74_d7afcc441442.slice/crio-f370bbad5a75407c0b734d59b2398e6bfcb458cd7ebb89ec13bd2d69a8ee37bf WatchSource:0}: Error finding container f370bbad5a75407c0b734d59b2398e6bfcb458cd7ebb89ec13bd2d69a8ee37bf: Status 404 returned error can't find the container with id f370bbad5a75407c0b734d59b2398e6bfcb458cd7ebb89ec13bd2d69a8ee37bf Jul 28 00:08:38.489065 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:38.488991 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" event={"ID":"4255e938-868c-4224-8b74-d7afcc441442","Type":"ContainerStarted","Data":"f370bbad5a75407c0b734d59b2398e6bfcb458cd7ebb89ec13bd2d69a8ee37bf"} Jul 28 00:08:38.560992 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:08:38.560951 2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:08:38.561162 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:08:38.561082 2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-gnzjt_cert-manager-operator(4255e938-868c-4224-8b74-d7afcc441442): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:08:38.561162 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:08:38.561138 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:08:38.940313 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:38.940283 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:39.040258 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:39.040229 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:39.493966 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:08:39.493933 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:08:43.725865 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:43.725829 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:43.827097 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:08:43.827061 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:08:50.637596 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:08:50.637549 2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:08:50.638041 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:08:50.637717 2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-gnzjt_cert-manager-operator(4255e938-868c-4224-8b74-d7afcc441442): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:08:50.638041 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:08:50.637777 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:09:02.862121 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:09:02.862088 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:09:05.605305 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:05.605276 2558 generic.go:356] "Generic (PLEG): container finished" podID="ff980859-8405-4c8d-a225-f5d65b0afcab" containerID="930101425b6548339b8992fb1d10742ea290bad7f7ac1f33acce85e18204a9db" exitCode=0 Jul 28 00:09:05.605601 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:05.605347 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29753280-pswrj" event={"ID":"ff980859-8405-4c8d-a225-f5d65b0afcab","Type":"ContainerDied","Data":"930101425b6548339b8992fb1d10742ea290bad7f7ac1f33acce85e18204a9db"} Jul 28 00:09:06.737882 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:06.737861 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:09:06.793289 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:06.793265 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff980859-8405-4c8d-a225-f5d65b0afcab-serviceca\") pod \"ff980859-8405-4c8d-a225-f5d65b0afcab\" (UID: \"ff980859-8405-4c8d-a225-f5d65b0afcab\") " Jul 28 00:09:06.793385 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:06.793326 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98kd6\" (UniqueName: \"kubernetes.io/projected/ff980859-8405-4c8d-a225-f5d65b0afcab-kube-api-access-98kd6\") pod \"ff980859-8405-4c8d-a225-f5d65b0afcab\" (UID: \"ff980859-8405-4c8d-a225-f5d65b0afcab\") " Jul 28 00:09:06.794102 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:06.794056 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff980859-8405-4c8d-a225-f5d65b0afcab-serviceca" (OuterVolumeSpecName: "serviceca") pod "ff980859-8405-4c8d-a225-f5d65b0afcab" (UID: "ff980859-8405-4c8d-a225-f5d65b0afcab"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:09:06.799257 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:06.796748 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff980859-8405-4c8d-a225-f5d65b0afcab-kube-api-access-98kd6" (OuterVolumeSpecName: "kube-api-access-98kd6") pod "ff980859-8405-4c8d-a225-f5d65b0afcab" (UID: "ff980859-8405-4c8d-a225-f5d65b0afcab"). InnerVolumeSpecName "kube-api-access-98kd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:09:06.894518 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:06.894492 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98kd6\" (UniqueName: \"kubernetes.io/projected/ff980859-8405-4c8d-a225-f5d65b0afcab-kube-api-access-98kd6\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:09:06.894518 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:06.894513 2558 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff980859-8405-4c8d-a225-f5d65b0afcab-serviceca\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:09:07.614653 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:07.614619 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29753280-pswrj" Jul 28 00:09:07.614841 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:07.614645 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29753280-pswrj" event={"ID":"ff980859-8405-4c8d-a225-f5d65b0afcab","Type":"ContainerDied","Data":"a7019e4f3721e6d648722f2c2eaaff9552b1e3f99553bb3b94fd8dfbadeacb91"} Jul 28 00:09:07.614841 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:07.614713 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7019e4f3721e6d648722f2c2eaaff9552b1e3f99553bb3b94fd8dfbadeacb91" Jul 28 00:09:16.934641 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:09:16.934596 2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:09:16.935071 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:09:16.934735 2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-gnzjt_cert-manager-operator(4255e938-868c-4224-8b74-d7afcc441442): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:09:16.935071 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:09:16.934793 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:09:31.862107 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:09:31.862073 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:09:44.862326 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:09:44.862287 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:09:50.441432 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:09:50.441402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:09:55.861956 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:09:55.861921 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:10:34.858049 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:10:34.858009 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:10:34.960333 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:10:34.960294 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:10:58.921236 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:10:58.921139 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/1.log" Jul 28 00:10:58.923463 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:10:58.922090 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/1.log" Jul 28 00:11:09.161186 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:09.161148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:10.354990 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:10.354895 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:11.065043 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:11.065006 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:11.127835 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:11.127801 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:12.603575 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.603543 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b86b68d9b-8kbhj"] Jul 28 00:11:12.603935 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.603875 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff980859-8405-4c8d-a225-f5d65b0afcab" containerName="image-pruner" Jul 28 00:11:12.603935 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.603889 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff980859-8405-4c8d-a225-f5d65b0afcab" containerName="image-pruner" Jul 28 00:11:12.604003 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.603949 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff980859-8405-4c8d-a225-f5d65b0afcab" containerName="image-pruner" Jul 28 00:11:12.606018 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.605999 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.619114 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.619092 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b86b68d9b-8kbhj"] Jul 28 00:11:12.670294 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.670259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:12.732949 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.732912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:12.755825 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.755804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-trusted-ca-bundle\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.755922 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.755829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-config\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.755922 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.755855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-serving-cert\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.756011 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.755934 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-service-ca\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.756011 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.755995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-oauth-serving-cert\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.756080 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.756027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj5j2\" (UniqueName: \"kubernetes.io/projected/4b53067b-4ce5-45b5-8b35-d849efa377d8-kube-api-access-lj5j2\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.756080 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.756044 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-oauth-config\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.856473 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.856420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-oauth-serving-cert\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.856473 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.856450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj5j2\" (UniqueName: \"kubernetes.io/projected/4b53067b-4ce5-45b5-8b35-d849efa377d8-kube-api-access-lj5j2\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.856473 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.856468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-oauth-config\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.856713 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.856488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-trusted-ca-bundle\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.856713 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.856508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-config\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.856713 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.856544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-serving-cert\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.856713 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.856577 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-service-ca\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.857235 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.857214 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-oauth-serving-cert\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.857348 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.857327 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-service-ca\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.857408 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.857391 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-trusted-ca-bundle\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.857442 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.857422 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-config\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.858975 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.858948 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-serving-cert\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.859063 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.859001 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b53067b-4ce5-45b5-8b35-d849efa377d8-console-oauth-config\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.865890 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.865866 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj5j2\" (UniqueName: \"kubernetes.io/projected/4b53067b-4ce5-45b5-8b35-d849efa377d8-kube-api-access-lj5j2\") pod \"console-b86b68d9b-8kbhj\" (UID: \"4b53067b-4ce5-45b5-8b35-d849efa377d8\") " pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:12.915715 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:12.915695 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:13.039332 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:13.039301 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b86b68d9b-8kbhj"] Jul 28 00:11:13.042346 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:11:13.042313 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b53067b_4ce5_45b5_8b35_d849efa377d8.slice/crio-720e613e71fb1c9696829c8b362f724cb820b0c77d3f7f04760f957070789f27 WatchSource:0}: Error finding container 720e613e71fb1c9696829c8b362f724cb820b0c77d3f7f04760f957070789f27: Status 404 returned error can't find the container with id 720e613e71fb1c9696829c8b362f724cb820b0c77d3f7f04760f957070789f27 Jul 28 00:11:13.127546 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:13.127509 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86b68d9b-8kbhj" event={"ID":"4b53067b-4ce5-45b5-8b35-d849efa377d8","Type":"ContainerStarted","Data":"43053f97420a5fc84ce583e641e647789b50866ad69b9b4bed6c21780cfa691c"} Jul 28 00:11:13.127698 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:13.127561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b86b68d9b-8kbhj" event={"ID":"4b53067b-4ce5-45b5-8b35-d849efa377d8","Type":"ContainerStarted","Data":"720e613e71fb1c9696829c8b362f724cb820b0c77d3f7f04760f957070789f27"} Jul 28 00:11:13.146680 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:13.146461 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b86b68d9b-8kbhj" podStartSLOduration=1.146445554 podStartE2EDuration="1.146445554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:11:13.145716065 +0000 UTC m=+614.809694063" watchObservedRunningTime="2026-07-28 00:11:13.146445554 +0000 UTC m=+614.810423553" Jul 28 00:11:14.993251 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:14.993209 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:22.916774 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:22.916683 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:22.916774 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:22.916740 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:22.921334 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:22.921308 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:23.173588 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:23.173520 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b86b68d9b-8kbhj" Jul 28 00:11:23.221317 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:23.221289 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7455645f64-nfgjj"] Jul 28 00:11:23.332083 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:23.332053 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:23.435328 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:23.435260 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:23.506493 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:23.506464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:11:48.245626 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.245583 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7455645f64-nfgjj" podUID="08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" containerName="console" containerID="cri-o://1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df" gracePeriod=15 Jul 28 00:11:48.476556 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.476529 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:11:48.594532 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.594474 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-config\") pod \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " Jul 28 00:11:48.594532 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.594509 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-serving-cert\") pod \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " Jul 28 00:11:48.594737 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.594540 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-oauth-config\") pod \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " Jul 28 00:11:48.594737 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.594686 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-service-ca\") pod \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " Jul 28 00:11:48.594737 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.594725 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-oauth-serving-cert\") pod \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " Jul 28 00:11:48.594891 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.594770 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk4zs\" (UniqueName: \"kubernetes.io/projected/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-kube-api-access-tk4zs\") pod \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " Jul 28 00:11:48.594891 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.594801 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-trusted-ca-bundle\") pod \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\" (UID: \"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712\") " Jul 28 00:11:48.594998 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.594973 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-config" (OuterVolumeSpecName: "console-config") pod "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" (UID: "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:11:48.595173 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.595133 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-service-ca" (OuterVolumeSpecName: "service-ca") pod "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" (UID: "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:11:48.595283 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.595162 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" (UID: "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:11:48.595350 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.595292 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" (UID: "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:11:48.596627 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.596605 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" (UID: "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:11:48.597014 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.596995 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" (UID: "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:11:48.597088 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.597063 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-kube-api-access-tk4zs" (OuterVolumeSpecName: "kube-api-access-tk4zs") pod "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" (UID: "08b6ab96-ed8e-4ee4-ace4-c70f5eee2712"). InnerVolumeSpecName "kube-api-access-tk4zs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:11:48.695911 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.695888 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk4zs\" (UniqueName: \"kubernetes.io/projected/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-kube-api-access-tk4zs\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:11:48.695911 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.695911 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-trusted-ca-bundle\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:11:48.696045 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.695924 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-config\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:11:48.696045 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.695936 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-serving-cert\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:11:48.696045 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.695947 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-console-oauth-config\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:11:48.696045 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.695958 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-service-ca\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:11:48.696045 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:48.695969 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712-oauth-serving-cert\") on node \"ip-10-0-140-17.ec2.internal\" DevicePath \"\"" Jul 28 00:11:49.282526 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.282442 2558 generic.go:356] "Generic (PLEG): container finished" podID="08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" containerID="1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df" exitCode=0 Jul 28 00:11:49.282526 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.282487 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7455645f64-nfgjj" Jul 28 00:11:49.282983 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.282541 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7455645f64-nfgjj" event={"ID":"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712","Type":"ContainerDied","Data":"1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df"} Jul 28 00:11:49.282983 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.282597 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7455645f64-nfgjj" event={"ID":"08b6ab96-ed8e-4ee4-ace4-c70f5eee2712","Type":"ContainerDied","Data":"852b5d37b43e2d8b188f86d92bb3359c3cacba26f5315a4f2d89a8d17582a296"} Jul 28 00:11:49.282983 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.282622 2558 scope.go:117] "RemoveContainer" containerID="1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df" Jul 28 00:11:49.291506 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.291463 2558 scope.go:117] "RemoveContainer" containerID="1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df" Jul 28 00:11:49.291786 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:11:49.291764 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df\": container with ID starting with 1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df not found: ID does not exist" containerID="1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df" Jul 28 00:11:49.291859 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.291797 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df"} err="failed to get container status \"1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df\": rpc error: code = NotFound desc = could not find container \"1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df\": container with ID starting with 1dbb1dcb5dfa9987c44d5954e805166f92ab39c5c4f918f2c6e05c55135709df not found: ID does not exist" Jul 28 00:11:49.297707 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.297680 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7455645f64-nfgjj"] Jul 28 00:11:49.300823 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:49.300799 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7455645f64-nfgjj"] Jul 28 00:11:50.865940 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:11:50.865906 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" path="/var/lib/kubelet/pods/08b6ab96-ed8e-4ee4-ace4-c70f5eee2712/volumes" Jul 28 00:11:51.330085 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:11:51.330038 2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:11:51.330262 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:11:51.330149 2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-gnzjt_cert-manager-operator(4255e938-868c-4224-8b74-d7afcc441442): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:11:51.330262 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:11:51.330187 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:12:01.114524 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:12:01.114479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:12:05.862586 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:12:05.862564 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:12:05.862937 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:12:05.862868 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:12:16.862875 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:12:16.862831 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:12:30.862285 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:12:30.862164 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:12:44.862694 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:12:44.862633 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:12:45.666731 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:12:45.666656 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:12:45.767785 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:12:45.767749 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:12:59.862294 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:12:59.862258 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:13:12.618576 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:13:12.618527 2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:13:12.619024 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:13:12.618737 2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-gnzjt_cert-manager-operator(4255e938-868c-4224-8b74-d7afcc441442): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:13:12.619024 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:13:12.618797 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:13:25.862378 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:13:25.862342 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:13:36.862209 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:13:36.862174 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:13:45.955794 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.955757 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6gfpx/must-gather-rplds"] Jul 28 00:13:45.956159 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.956035 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" containerName="console" Jul 28 00:13:45.956159 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.956045 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" containerName="console" Jul 28 00:13:45.956159 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.956096 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="08b6ab96-ed8e-4ee4-ace4-c70f5eee2712" containerName="console" Jul 28 00:13:45.959150 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.959134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6gfpx/must-gather-rplds" Jul 28 00:13:45.961250 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.961230 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6gfpx\"/\"openshift-service-ca.crt\"" Jul 28 00:13:45.961434 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.961422 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6gfpx\"/\"kube-root-ca.crt\"" Jul 28 00:13:45.961930 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.961914 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6gfpx\"/\"default-dockercfg-5nmsn\"" Jul 28 00:13:45.969290 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.969270 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6gfpx/must-gather-rplds"] Jul 28 00:13:45.994239 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:45.994204 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:13:46.084067 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.084029 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" limit=1024 Jul 28 00:13:46.124195 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.124164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7db11b2d-a1e8-451c-a78b-a2305c69dfd4-must-gather-output\") pod \"must-gather-rplds\" (UID: \"7db11b2d-a1e8-451c-a78b-a2305c69dfd4\") " pod="openshift-must-gather-6gfpx/must-gather-rplds" Jul 28 00:13:46.124350 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.124240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lnf4\" (UniqueName: \"kubernetes.io/projected/7db11b2d-a1e8-451c-a78b-a2305c69dfd4-kube-api-access-8lnf4\") pod \"must-gather-rplds\" (UID: \"7db11b2d-a1e8-451c-a78b-a2305c69dfd4\") " pod="openshift-must-gather-6gfpx/must-gather-rplds" Jul 28 00:13:46.224872 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.224784 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lnf4\" (UniqueName: \"kubernetes.io/projected/7db11b2d-a1e8-451c-a78b-a2305c69dfd4-kube-api-access-8lnf4\") pod \"must-gather-rplds\" (UID: \"7db11b2d-a1e8-451c-a78b-a2305c69dfd4\") " pod="openshift-must-gather-6gfpx/must-gather-rplds" Jul 28 00:13:46.224872 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.224832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7db11b2d-a1e8-451c-a78b-a2305c69dfd4-must-gather-output\") pod \"must-gather-rplds\" (UID: \"7db11b2d-a1e8-451c-a78b-a2305c69dfd4\") " pod="openshift-must-gather-6gfpx/must-gather-rplds" Jul 28 00:13:46.225118 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.225103 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7db11b2d-a1e8-451c-a78b-a2305c69dfd4-must-gather-output\") pod \"must-gather-rplds\" (UID: \"7db11b2d-a1e8-451c-a78b-a2305c69dfd4\") " pod="openshift-must-gather-6gfpx/must-gather-rplds" Jul 28 00:13:46.233330 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.233297 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lnf4\" (UniqueName: \"kubernetes.io/projected/7db11b2d-a1e8-451c-a78b-a2305c69dfd4-kube-api-access-8lnf4\") pod \"must-gather-rplds\" (UID: \"7db11b2d-a1e8-451c-a78b-a2305c69dfd4\") " pod="openshift-must-gather-6gfpx/must-gather-rplds" Jul 28 00:13:46.281967 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.281936 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6gfpx/must-gather-rplds" Jul 28 00:13:46.409298 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.409258 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6gfpx/must-gather-rplds"] Jul 28 00:13:46.412032 ip-10-0-140-17 kubenswrapper[2558]: W0728 00:13:46.411997 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7db11b2d_a1e8_451c_a78b_a2305c69dfd4.slice/crio-d0290717147533959d50605aaeb519e846bb083dadfdb19498afbd964388e367 WatchSource:0}: Error finding container d0290717147533959d50605aaeb519e846bb083dadfdb19498afbd964388e367: Status 404 returned error can't find the container with id d0290717147533959d50605aaeb519e846bb083dadfdb19498afbd964388e367 Jul 28 00:13:46.755685 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:46.755633 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6gfpx/must-gather-rplds" event={"ID":"7db11b2d-a1e8-451c-a78b-a2305c69dfd4","Type":"ContainerStarted","Data":"d0290717147533959d50605aaeb519e846bb083dadfdb19498afbd964388e367"} Jul 28 00:13:47.765144 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:47.764301 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6gfpx/must-gather-rplds" event={"ID":"7db11b2d-a1e8-451c-a78b-a2305c69dfd4","Type":"ContainerStarted","Data":"51872490d1a6a0718cf50d6bcd238b29d5679db3eefe8850d5fc2fd5b5753a78"} Jul 28 00:13:47.765144 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:47.764357 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6gfpx/must-gather-rplds" event={"ID":"7db11b2d-a1e8-451c-a78b-a2305c69dfd4","Type":"ContainerStarted","Data":"bf7095bf13858143dcfb12044279915e3761be1712eddf177d2baf7b862b971b"} Jul 28 00:13:47.781719 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:47.781643 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6gfpx/must-gather-rplds" podStartSLOduration=2.072456483 podStartE2EDuration="2.781623997s" totalImagesPullingTime="709.167514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:13:47.781325607 +0000 UTC m=+769.445303606" watchObservedRunningTime="2026-07-28 00:13:47.781623997 +0000 UTC m=+769.445601996" Jul 28 00:13:48.458942 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:48.458908 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b8mns_d75b25e5-477e-4784-956b-672905da91a3/global-pull-secret-syncer/0.log" Jul 28 00:13:48.545208 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:48.545175 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2q8nf_1f2549e0-1b4c-4075-895a-307dfb86bf78/konnectivity-agent/0.log" Jul 28 00:13:48.654879 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:48.654844 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-17.ec2.internal_82e831ea1e0a8337ebcffdb7c227d0e6/haproxy/0.log" Jul 28 00:13:50.868653 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:13:50.867136 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:13:52.999245 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:52.999198 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpjpb_2aca83c4-cff7-4a09-acb1-24f7863732fb/node-exporter/0.log" Jul 28 00:13:53.018698 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:53.018653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpjpb_2aca83c4-cff7-4a09-acb1-24f7863732fb/kube-rbac-proxy/0.log" Jul 28 00:13:53.044089 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:53.044059 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpjpb_2aca83c4-cff7-4a09-acb1-24f7863732fb/init-textfile/0.log" Jul 28 00:13:53.397232 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:53.397190 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-26nkz_dfc50906-d30b-419f-ac07-98a3177970dd/prometheus-operator/0.log" Jul 28 00:13:53.420457 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:53.420428 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-26nkz_dfc50906-d30b-419f-ac07-98a3177970dd/kube-rbac-proxy/0.log" Jul 28 00:13:53.452935 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:53.452893 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-g588n_6f4a586e-6e1b-4bae-8aec-93b56aa4b904/prometheus-operator-admission-webhook/0.log" Jul 28 00:13:53.518984 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:53.518949 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dbc4985bc-g64qj_b07571af-1a8e-40a4-9267-adab88c68a74/telemeter-client/0.log" Jul 28 00:13:53.547709 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:53.547660 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dbc4985bc-g64qj_b07571af-1a8e-40a4-9267-adab88c68a74/reload/0.log" Jul 28 00:13:53.587500 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:53.587475 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dbc4985bc-g64qj_b07571af-1a8e-40a4-9267-adab88c68a74/kube-rbac-proxy/0.log" Jul 28 00:13:54.818780 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:54.818747 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-pdx68_7cf66491-1481-432c-9286-3e56a7efd5dd/networking-console-plugin/0.log" Jul 28 00:13:55.255212 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:55.255181 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/1.log" Jul 28 00:13:55.264141 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:55.264098 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cxz6d_c52f2d7b-8638-42ff-b315-084674fbfa2b/console-operator/2.log" Jul 28 00:13:55.626144 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:55.626119 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b86b68d9b-8kbhj_4b53067b-4ce5-45b5-8b35-d849efa377d8/console/0.log" Jul 28 00:13:56.104896 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.104823 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6"] Jul 28 00:13:56.110635 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.110601 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.124286 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.124246 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6"] Jul 28 00:13:56.217167 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.217124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmcfh\" (UniqueName: \"kubernetes.io/projected/1fec368d-8530-4746-bdf0-9b4ec344553b-kube-api-access-fmcfh\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.217383 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.217198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-proc\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.217383 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.217234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-sys\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.217383 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.217268 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-lib-modules\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.217383 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.217338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-podres\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318351 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318315 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmcfh\" (UniqueName: \"kubernetes.io/projected/1fec368d-8530-4746-bdf0-9b4ec344553b-kube-api-access-fmcfh\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318537 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-proc\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318537 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-sys\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318537 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318406 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-lib-modules\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318537 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318446 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-podres\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318537 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318472 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-proc\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318537 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318507 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-sys\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318814 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318616 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-lib-modules\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.318814 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.318642 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1fec368d-8530-4746-bdf0-9b4ec344553b-podres\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.327497 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.327464 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmcfh\" (UniqueName: \"kubernetes.io/projected/1fec368d-8530-4746-bdf0-9b4ec344553b-kube-api-access-fmcfh\") pod \"perf-node-gather-daemonset-ffhm6\" (UID: \"1fec368d-8530-4746-bdf0-9b4ec344553b\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.428701 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.428653 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.575928 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.575894 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6"] Jul 28 00:13:56.821295 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.821261 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" event={"ID":"1fec368d-8530-4746-bdf0-9b4ec344553b","Type":"ContainerStarted","Data":"5c77b264912ced48da093de5baef9fd8fb4f7beb7392e992a37a21de47f77892"} Jul 28 00:13:56.821489 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.821314 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" event={"ID":"1fec368d-8530-4746-bdf0-9b4ec344553b","Type":"ContainerStarted","Data":"78785534ccfdd81e41cf8e9f4fc3799183d5b2b822835dc04022bb92c4650b11"} Jul 28 00:13:56.821489 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.821342 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:13:56.842129 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:56.842079 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" podStartSLOduration=0.842063781 podStartE2EDuration="842.063781ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:13:56.841485955 +0000 UTC m=+778.505463953" watchObservedRunningTime="2026-07-28 00:13:56.842063781 +0000 UTC m=+778.506041776" Jul 28 00:13:57.027316 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:57.027241 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-htw4s_e3049a2d-6e5e-446b-b0d5-e18425a57881/dns/0.log" Jul 28 00:13:57.048840 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:57.048807 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-htw4s_e3049a2d-6e5e-446b-b0d5-e18425a57881/kube-rbac-proxy/0.log" Jul 28 00:13:57.161711 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:57.161658 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zrkn7_d53ee3dc-2347-4ca8-b291-8cc159b35b3a/dns-node-resolver/0.log" Jul 28 00:13:57.537288 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:57.537254 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29753280-pswrj_ff980859-8405-4c8d-a225-f5d65b0afcab/image-pruner/0.log" Jul 28 00:13:57.588349 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:57.588320 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-76s8v_86e539ab-26b7-4771-acfb-8dfa0bbde7b9/node-ca/0.log" Jul 28 00:13:58.615733 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:58.615696 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k95mb_dec66b39-7e3c-4b1c-b4ed-ab609bc7aa3d/serve-healthcheck-canary/0.log" Jul 28 00:13:59.076371 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:59.076321 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bh6wr_07720ded-c51d-4fd1-aa97-a6e66125ec67/kube-rbac-proxy/0.log" Jul 28 00:13:59.097132 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:59.097108 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bh6wr_07720ded-c51d-4fd1-aa97-a6e66125ec67/exporter/0.log" Jul 28 00:13:59.120119 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:13:59.120090 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bh6wr_07720ded-c51d-4fd1-aa97-a6e66125ec67/extractor/0.log" Jul 28 00:14:02.838297 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:02.838264 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-ffhm6" Jul 28 00:14:02.867725 ip-10-0-140-17 kubenswrapper[2558]: E0728 00:14:02.867659 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gnzjt" podUID="4255e938-868c-4224-8b74-d7afcc441442" Jul 28 00:14:03.211020 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:03.210981 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-pbj72_cb3fce77-cc6b-45c7-a889-8eff941fadc9/migrator/0.log" Jul 28 00:14:03.231495 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:03.231470 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-pbj72_cb3fce77-cc6b-45c7-a889-8eff941fadc9/graceful-termination/0.log" Jul 28 00:14:04.508906 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.508871 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz24k_ca182ea3-4769-4e84-9ff7-121474b20948/kube-multus-additional-cni-plugins/0.log" Jul 28 00:14:04.536487 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.536458 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz24k_ca182ea3-4769-4e84-9ff7-121474b20948/egress-router-binary-copy/0.log" Jul 28 00:14:04.558302 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.558262 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz24k_ca182ea3-4769-4e84-9ff7-121474b20948/cni-plugins/0.log" Jul 28 00:14:04.582173 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.582143 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz24k_ca182ea3-4769-4e84-9ff7-121474b20948/bond-cni-plugin/0.log" Jul 28 00:14:04.606705 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.606662 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz24k_ca182ea3-4769-4e84-9ff7-121474b20948/routeoverride-cni/0.log" Jul 28 00:14:04.631596 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.631572 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz24k_ca182ea3-4769-4e84-9ff7-121474b20948/whereabouts-cni-bincopy/0.log" Jul 28 00:14:04.653802 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.653774 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz24k_ca182ea3-4769-4e84-9ff7-121474b20948/whereabouts-cni/0.log" Jul 28 00:14:04.940389 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.940359 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wlk4t_4448a632-9359-4650-9c0f-4778b59e235c/kube-multus/0.log" Jul 28 00:14:04.962398 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.962346 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dtwj5_3f0d0fd9-0703-4cb3-ab02-11dce13801a3/network-metrics-daemon/0.log" Jul 28 00:14:04.983113 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:04.983084 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dtwj5_3f0d0fd9-0703-4cb3-ab02-11dce13801a3/kube-rbac-proxy/0.log" Jul 28 00:14:05.858916 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:05.858887 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4vmm_fbf5a98c-f4cc-47fa-9182-4227d1d531c6/ovn-controller/0.log" Jul 28 00:14:05.874291 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:05.874264 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4vmm_fbf5a98c-f4cc-47fa-9182-4227d1d531c6/ovn-acl-logging/0.log" Jul 28 00:14:05.907556 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:05.907490 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4vmm_fbf5a98c-f4cc-47fa-9182-4227d1d531c6/kube-rbac-proxy-node/0.log" Jul 28 00:14:05.931272 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:05.931248 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4vmm_fbf5a98c-f4cc-47fa-9182-4227d1d531c6/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 00:14:05.948850 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:05.948824 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4vmm_fbf5a98c-f4cc-47fa-9182-4227d1d531c6/northd/0.log" Jul 28 00:14:05.968065 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:05.968043 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4vmm_fbf5a98c-f4cc-47fa-9182-4227d1d531c6/nbdb/0.log" Jul 28 00:14:05.986906 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:05.986881 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4vmm_fbf5a98c-f4cc-47fa-9182-4227d1d531c6/sbdb/0.log" Jul 28 00:14:06.039565 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:06.039538 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t4vmm_fbf5a98c-f4cc-47fa-9182-4227d1d531c6/ovnkube-controller/0.log" Jul 28 00:14:07.364606 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:07.364557 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-kk6w6_d5164661-5fbb-4e7b-8c91-fd1b5038bd29/check-endpoints/0.log" Jul 28 00:14:07.392757 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:07.392688 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8vf2s_87a60940-9b1c-499b-85b4-31c44493cc32/network-check-target-container/0.log" Jul 28 00:14:08.231054 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:08.231025 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8wdmt_a26ab917-2327-4c6d-ba63-f3310f7e9347/iptables-alerter/0.log" Jul 28 00:14:08.824340 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:08.824313 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2gj6b_4d17ec1a-0b7b-4180-85a6-a8d521015c38/tuned/0.log" Jul 28 00:14:10.460380 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:10.460333 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-9lgv7_217e5a52-b80a-4f88-8d7c-105fbda43885/cluster-samples-operator/0.log" Jul 28 00:14:10.478763 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:10.478729 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-9lgv7_217e5a52-b80a-4f88-8d7c-105fbda43885/cluster-samples-operator-watch/0.log" Jul 28 00:14:11.357259 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:11.357225 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d6c75f84f-c6666_6fdd80f7-e31b-4a9c-a6de-d6061d1bd935/service-ca-operator/1.log" Jul 28 00:14:11.358575 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:11.358555 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d6c75f84f-c6666_6fdd80f7-e31b-4a9c-a6de-d6061d1bd935/service-ca-operator/0.log" Jul 28 00:14:12.091498 ip-10-0-140-17 kubenswrapper[2558]: I0728 00:14:12.091450 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-lbgpp_18c495b6-909a-464c-818e-4dfd46285873/csi-driver/0.log"