W0418 07:52:24.972435 1 cmd.go:257] Using insecure, self-signed certificates I0418 07:52:25.350378 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 07:52:25.350706 1 observer_polling.go:159] Starting file observer I0418 07:52:26.143712 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0418 07:52:26.143918 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0418 07:52:26.144515 1 secure_serving.go:57] Forcing use of http/1.1 only W0418 07:52:26.144534 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0418 07:52:26.144538 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0418 07:52:26.144542 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0418 07:52:26.144544 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0418 07:52:26.144548 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0418 07:52:26.144550 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0418 07:52:26.144575 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0418 07:52:26.149060 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0418 07:52:26.149127 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"ef03ad02-2bf8-4594-8ccc-78f2cf12f204", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0418 07:52:26.151652 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0418 07:52:26.151669 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0418 07:52:26.151673 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0418 07:52:26.151672 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0418 07:52:26.151726 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0418 07:52:26.151731 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0418 07:52:26.152059 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-769899121/tls.crt::/tmp/serving-cert-769899121/tls.key" I0418 07:52:26.152384 1 secure_serving.go:213] Serving securely on [::]:8443 I0418 07:52:26.152414 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0418 07:52:26.155796 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0418 07:52:26.155822 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0418 07:52:26.155942 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0418 07:52:26.161184 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0418 07:52:26.161201 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0418 07:52:26.166763 1 secretconfigobserver.go:119] support secret does not exist I0418 07:52:26.171421 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0418 07:52:26.175708 1 secretconfigobserver.go:119] support secret does not exist I0418 07:52:26.178389 1 recorder.go:161] Pruning old reports every 6h9m1s, max age is 288h0m0s I0418 07:52:26.184293 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0418 07:52:26.184301 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0418 07:52:26.184312 1 insightsreport.go:296] Starting report retriever I0418 07:52:26.184313 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0418 07:52:26.184317 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0418 07:52:26.184341 1 periodic.go:209] Running clusterconfig gatherer I0418 07:52:26.184394 1 tasks_processing.go:45] number of workers: 64 I0418 07:52:26.184422 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 07:52:26.184434 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 07:52:26.184444 1 tasks_processing.go:69] worker 12 listening for tasks. I0418 07:52:26.184445 1 tasks_processing.go:69] worker 31 listening for tasks. I0418 07:52:26.184446 1 tasks_processing.go:69] worker 22 listening for tasks. I0418 07:52:26.184450 1 tasks_processing.go:69] worker 2 listening for tasks. I0418 07:52:26.184457 1 tasks_processing.go:69] worker 24 listening for tasks. I0418 07:52:26.184459 1 tasks_processing.go:69] worker 4 listening for tasks. I0418 07:52:26.184465 1 tasks_processing.go:69] worker 9 listening for tasks. I0418 07:52:26.184470 1 tasks_processing.go:71] worker 24 working on networks task. I0418 07:52:26.184472 1 tasks_processing.go:69] worker 32 listening for tasks. I0418 07:52:26.184470 1 tasks_processing.go:69] worker 17 listening for tasks. I0418 07:52:26.184480 1 tasks_processing.go:71] worker 32 working on container_images task. I0418 07:52:26.184483 1 tasks_processing.go:69] worker 25 listening for tasks. I0418 07:52:26.184484 1 tasks_processing.go:69] worker 5 listening for tasks. I0418 07:52:26.184482 1 tasks_processing.go:69] worker 8 listening for tasks. I0418 07:52:26.184471 1 tasks_processing.go:69] worker 10 listening for tasks. I0418 07:52:26.184493 1 tasks_processing.go:69] worker 7 listening for tasks. I0418 07:52:26.184498 1 tasks_processing.go:69] worker 14 listening for tasks. I0418 07:52:26.184477 1 tasks_processing.go:71] worker 9 working on metrics task. I0418 07:52:26.184499 1 tasks_processing.go:69] worker 6 listening for tasks. I0418 07:52:26.184509 1 tasks_processing.go:69] worker 15 listening for tasks. I0418 07:52:26.184511 1 tasks_processing.go:69] worker 20 listening for tasks. I0418 07:52:26.184517 1 tasks_processing.go:69] worker 28 listening for tasks. I0418 07:52:26.184518 1 tasks_processing.go:69] worker 18 listening for tasks. I0418 07:52:26.184521 1 tasks_processing.go:69] worker 16 listening for tasks. I0418 07:52:26.184525 1 tasks_processing.go:69] worker 19 listening for tasks. I0418 07:52:26.184454 1 tasks_processing.go:69] worker 3 listening for tasks. I0418 07:52:26.184519 1 tasks_processing.go:69] worker 50 listening for tasks. I0418 07:52:26.184530 1 tasks_processing.go:69] worker 30 listening for tasks. I0418 07:52:26.184534 1 tasks_processing.go:69] worker 56 listening for tasks. I0418 07:52:26.184462 1 tasks_processing.go:71] worker 22 working on aggregated_monitoring_cr_names task. I0418 07:52:26.184541 1 tasks_processing.go:69] worker 35 listening for tasks. I0418 07:52:26.184543 1 tasks_processing.go:69] worker 55 listening for tasks. I0418 07:52:26.184539 1 tasks_processing.go:69] worker 21 listening for tasks. I0418 07:52:26.184553 1 tasks_processing.go:69] worker 43 listening for tasks. I0418 07:52:26.184543 1 tasks_processing.go:69] worker 53 listening for tasks. I0418 07:52:26.184561 1 tasks_processing.go:69] worker 60 listening for tasks. I0418 07:52:26.184490 1 tasks_processing.go:69] worker 13 listening for tasks. I0418 07:52:26.184563 1 tasks_processing.go:71] worker 12 working on pod_network_connectivity_checks task. I0418 07:52:26.184569 1 tasks_processing.go:69] worker 41 listening for tasks. I0418 07:52:26.184571 1 tasks_processing.go:69] worker 46 listening for tasks. I0418 07:52:26.184496 1 tasks_processing.go:69] worker 27 listening for tasks. I0418 07:52:26.184451 1 tasks_processing.go:69] worker 23 listening for tasks. I0418 07:52:26.184579 1 tasks_processing.go:69] worker 42 listening for tasks. I0418 07:52:26.184524 1 tasks_processing.go:69] worker 29 listening for tasks. I0418 07:52:26.184585 1 tasks_processing.go:69] worker 63 listening for tasks. I0418 07:52:26.184527 1 tasks_processing.go:69] worker 33 listening for tasks. I0418 07:52:26.184594 1 tasks_processing.go:69] worker 48 listening for tasks. I0418 07:52:26.184592 1 tasks_processing.go:69] worker 49 listening for tasks. I0418 07:52:26.184598 1 tasks_processing.go:71] worker 28 working on olm_operators task. I0418 07:52:26.184598 1 tasks_processing.go:71] worker 6 working on crds task. I0418 07:52:26.184600 1 tasks_processing.go:71] worker 7 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0418 07:52:26.184602 1 tasks_processing.go:71] worker 17 working on openstack_version task. I0418 07:52:26.184606 1 tasks_processing.go:71] worker 49 working on nodenetworkconfigurationpolicies task. I0418 07:52:26.184598 1 tasks_processing.go:69] worker 59 listening for tasks. I0418 07:52:26.184620 1 tasks_processing.go:71] worker 3 working on overlapping_namespace_uids task. I0418 07:52:26.184625 1 tasks_processing.go:71] worker 59 working on version task. I0418 07:52:26.184610 1 tasks_processing.go:71] worker 18 working on machines task. I0418 07:52:26.184681 1 tasks_processing.go:71] worker 14 working on validating_webhook_configurations task. I0418 07:52:26.184726 1 tasks_processing.go:71] worker 30 working on sap_pods task. I0418 07:52:26.184554 1 tasks_processing.go:69] worker 58 listening for tasks. I0418 07:52:26.184870 1 tasks_processing.go:71] worker 58 working on image_registries task. I0418 07:52:26.184724 1 tasks_processing.go:71] worker 50 working on sap_config task. I0418 07:52:26.184534 1 tasks_processing.go:69] worker 34 listening for tasks. I0418 07:52:26.184470 1 tasks_processing.go:71] worker 4 working on container_runtime_configs task. I0418 07:52:26.184988 1 tasks_processing.go:71] worker 34 working on machine_autoscalers task. I0418 07:52:26.184682 1 tasks_processing.go:71] worker 5 working on machine_config_pools task. I0418 07:52:26.184537 1 tasks_processing.go:69] worker 52 listening for tasks. I0418 07:52:26.184543 1 tasks_processing.go:69] worker 51 listening for tasks. W0418 07:52:26.184541 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 07:52:26.184476 1 tasks_processing.go:69] worker 11 listening for tasks. I0418 07:52:26.184553 1 tasks_processing.go:71] worker 1 working on storage_classes task. I0418 07:52:26.185238 1 tasks_processing.go:71] worker 9 working on clusterroles task. I0418 07:52:26.184556 1 tasks_processing.go:69] worker 44 listening for tasks. I0418 07:52:26.184555 1 tasks_processing.go:69] worker 57 listening for tasks. I0418 07:52:26.184562 1 tasks_processing.go:69] worker 40 listening for tasks. I0418 07:52:26.184562 1 tasks_processing.go:69] worker 45 listening for tasks. I0418 07:52:26.184570 1 tasks_processing.go:69] worker 61 listening for tasks. I0418 07:52:26.184579 1 tasks_processing.go:69] worker 62 listening for tasks. I0418 07:52:26.184577 1 tasks_processing.go:71] worker 31 working on silenced_alerts task. I0418 07:52:26.185264 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 725.808µs to process 0 records I0418 07:52:26.184576 1 tasks_processing.go:69] worker 39 listening for tasks. I0418 07:52:26.185283 1 tasks_processing.go:71] worker 39 working on machine_configs task. W0418 07:52:26.185293 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 07:52:26.185302 1 tasks_processing.go:71] worker 57 working on nodes task. I0418 07:52:26.185309 1 tasks_processing.go:71] worker 45 working on image_pruners task. I0418 07:52:26.185313 1 tasks_processing.go:71] worker 61 working on jaegers task. I0418 07:52:26.185312 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 29.392µs to process 0 records I0418 07:52:26.184586 1 tasks_processing.go:69] worker 47 listening for tasks. I0418 07:52:26.184582 1 tasks_processing.go:69] worker 37 listening for tasks. I0418 07:52:26.185332 1 tasks_processing.go:71] worker 47 working on proxies task. I0418 07:52:26.185304 1 tasks_processing.go:71] worker 31 working on service_accounts task. I0418 07:52:26.185346 1 tasks_processing.go:71] worker 11 working on qemu_kubevirt_launcher_logs task. I0418 07:52:26.184590 1 tasks_processing.go:69] worker 38 listening for tasks. I0418 07:52:26.184598 1 tasks_processing.go:71] worker 10 working on ingress_certificates task. I0418 07:52:26.185309 1 tasks_processing.go:71] worker 40 working on config_maps task. I0418 07:52:26.185465 1 tasks_processing.go:71] worker 44 working on nodenetworkstates task. I0418 07:52:26.185487 1 tasks_processing.go:71] worker 38 working on install_plans task. I0418 07:52:26.185513 1 tasks_processing.go:71] worker 37 working on cost_management_metrics_configs task. I0418 07:52:26.184605 1 tasks_processing.go:71] worker 21 working on node_logs task. I0418 07:52:26.184614 1 tasks_processing.go:71] worker 16 working on openstack_dataplanenodesets task. I0418 07:52:26.184586 1 tasks_processing.go:71] worker 0 working on operators_pods_and_events task. I0418 07:52:26.184617 1 tasks_processing.go:71] worker 19 working on feature_gates task. I0418 07:52:26.184686 1 tasks_processing.go:71] worker 25 working on support_secret task. I0418 07:52:26.184693 1 tasks_processing.go:71] worker 8 working on ceph_cluster task. I0418 07:52:26.184717 1 tasks_processing.go:71] worker 35 working on machine_healthchecks task. I0418 07:52:26.184490 1 tasks_processing.go:69] worker 26 listening for tasks. I0418 07:52:26.184699 1 tasks_processing.go:71] worker 56 working on openstack_dataplanedeployments task. I0418 07:52:26.185958 1 tasks_processing.go:71] worker 26 working on mutating_webhook_configurations task. I0418 07:52:26.184536 1 tasks_processing.go:69] worker 54 listening for tasks. I0418 07:52:26.186008 1 tasks_processing.go:71] worker 54 working on sap_datahubs task. I0418 07:52:26.184736 1 tasks_processing.go:71] worker 27 working on oauths task. I0418 07:52:26.184736 1 tasks_processing.go:71] worker 60 working on machine_sets task. I0418 07:52:26.184740 1 tasks_processing.go:71] worker 13 working on storage_cluster task. I0418 07:52:26.184741 1 tasks_processing.go:71] worker 43 working on schedulers task. I0418 07:52:26.184744 1 tasks_processing.go:71] worker 41 working on ingress task. I0418 07:52:26.184748 1 tasks_processing.go:71] worker 53 working on monitoring_persistent_volumes task. I0418 07:52:26.184749 1 tasks_processing.go:71] worker 46 working on openshift_logging task. I0418 07:52:26.184755 1 tasks_processing.go:71] worker 29 working on lokistack task. I0418 07:52:26.184755 1 tasks_processing.go:71] worker 55 working on infrastructures task. I0418 07:52:26.184759 1 tasks_processing.go:71] worker 23 working on dvo_metrics task. I0418 07:52:26.184762 1 tasks_processing.go:71] worker 33 working on openshift_machine_api_events task. I0418 07:52:26.184763 1 tasks_processing.go:71] worker 42 working on cluster_apiserver task. I0418 07:52:26.184767 1 tasks_processing.go:71] worker 63 working on active_alerts task. I0418 07:52:26.184769 1 tasks_processing.go:71] worker 48 working on pdbs task. W0418 07:52:26.186758 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 07:52:26.186771 1 tasks_processing.go:74] worker 63 stopped. I0418 07:52:26.186780 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 27.66µs to process 0 records I0418 07:52:26.184463 1 tasks_processing.go:71] worker 2 working on tsdb_status task. I0418 07:52:26.185181 1 tasks_processing.go:71] worker 52 working on authentication task. W0418 07:52:26.186833 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 07:52:26.186843 1 tasks_processing.go:74] worker 2 stopped. I0418 07:52:26.186852 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 19.014µs to process 0 records I0418 07:52:26.185228 1 tasks_processing.go:71] worker 51 working on image task. I0418 07:52:26.184550 1 tasks_processing.go:69] worker 36 listening for tasks. I0418 07:52:26.186942 1 tasks_processing.go:74] worker 36 stopped. I0418 07:52:26.185302 1 tasks_processing.go:71] worker 62 working on operators task. I0418 07:52:26.184675 1 tasks_processing.go:71] worker 20 working on certificate_signing_requests task. I0418 07:52:26.184671 1 tasks_processing.go:71] worker 15 working on openstack_controlplanes task. I0418 07:52:26.189138 1 tasks_processing.go:74] worker 12 stopped. E0418 07:52:26.189148 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0418 07:52:26.189160 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 4.558577ms to process 0 records I0418 07:52:26.189169 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 4.528804ms to process 0 records I0418 07:52:26.189175 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 4.557817ms to process 0 records I0418 07:52:26.189183 1 tasks_processing.go:74] worker 17 stopped. I0418 07:52:26.189187 1 tasks_processing.go:74] worker 49 stopped. I0418 07:52:26.189420 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0418 07:52:26.189438 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0418 07:52:26.189442 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0418 07:52:26.189446 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0418 07:52:26.189464 1 controller.go:489] The operator is still being initialized I0418 07:52:26.189472 1 controller.go:512] The operator is healthy I0418 07:52:26.192606 1 tasks_processing.go:74] worker 4 stopped. I0418 07:52:26.192622 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 7.673033ms to process 0 records I0418 07:52:26.192722 1 tasks_processing.go:74] worker 18 stopped. E0418 07:52:26.192735 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0418 07:52:26.192744 1 gather.go:177] gatherer "clusterconfig" function "machines" took 8.033578ms to process 0 records I0418 07:52:26.193186 1 tasks_processing.go:74] worker 24 stopped. I0418 07:52:26.193360 1 recorder.go:75] Recording config/network with fingerprint=1d390ddd6e7a275b05cb8f3b0b1df72d90c20933858b1fad7c0209ef06f612cc I0418 07:52:26.193372 1 gather.go:177] gatherer "clusterconfig" function "networks" took 8.700605ms to process 1 records I0418 07:52:26.206131 1 tasks_processing.go:74] worker 37 stopped. I0418 07:52:26.206147 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 20.609004ms to process 0 records I0418 07:52:26.206158 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 20.650704ms to process 0 records I0418 07:52:26.206164 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 21.120001ms to process 0 records I0418 07:52:26.206169 1 tasks_processing.go:74] worker 34 stopped. I0418 07:52:26.206172 1 tasks_processing.go:74] worker 44 stopped. I0418 07:52:26.209176 1 tasks_processing.go:74] worker 47 stopped. I0418 07:52:26.209259 1 recorder.go:75] Recording config/proxy with fingerprint=b3d535280eeded4f34d6ed30db3fac83d7fb045b0963cb5a7413de2e6de77b4f I0418 07:52:26.209276 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 23.826899ms to process 1 records I0418 07:52:26.209941 1 tasks_processing.go:74] worker 56 stopped. I0418 07:52:26.209954 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 23.976115ms to process 0 records I0418 07:52:26.210050 1 tasks_processing.go:74] worker 30 stopped. I0418 07:52:26.210064 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 25.270738ms to process 0 records I0418 07:52:26.211254 1 tasks_processing.go:74] worker 61 stopped. I0418 07:52:26.211269 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 25.929803ms to process 0 records I0418 07:52:26.211291 1 tasks_processing.go:74] worker 15 stopped. I0418 07:52:26.211302 1 gather_logs.go:145] no pods in namespace were found I0418 07:52:26.211307 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 24.1945ms to process 0 records I0418 07:52:26.211315 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 25.957789ms to process 0 records I0418 07:52:26.211324 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 24.883594ms to process 0 records I0418 07:52:26.211329 1 tasks_processing.go:74] worker 29 stopped. I0418 07:52:26.211335 1 tasks_processing.go:74] worker 11 stopped. I0418 07:52:26.211374 1 tasks_processing.go:74] worker 16 stopped. I0418 07:52:26.211389 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 25.721232ms to process 0 records I0418 07:52:26.211496 1 tasks_processing.go:74] worker 60 stopped. I0418 07:52:26.211511 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 25.412874ms to process 0 records I0418 07:52:26.211525 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 25.152425ms to process 0 records I0418 07:52:26.211534 1 tasks_processing.go:74] worker 46 stopped. I0418 07:52:26.211565 1 tasks_processing.go:74] worker 54 stopped. I0418 07:52:26.211580 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 25.547962ms to process 0 records I0418 07:52:26.211599 1 tasks_processing.go:74] worker 50 stopped. I0418 07:52:26.211612 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 26.702639ms to process 0 records I0418 07:52:26.211661 1 tasks_processing.go:74] worker 42 stopped. I0418 07:52:26.211886 1 recorder.go:75] Recording config/apiserver with fingerprint=fb69d2185bf2a126f825986e83d80158d0a9bbd6d72859eef2014eb0fbff3a4d I0418 07:52:26.211922 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 24.983167ms to process 1 records I0418 07:52:26.212000 1 tasks_processing.go:74] worker 55 stopped. I0418 07:52:26.212497 1 recorder.go:75] Recording config/infrastructure with fingerprint=b72abaff83667f113fade7f044ee1fb911edfbd9f1c5f83ea61a3fda0b8f38ec I0418 07:52:26.212513 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 25.165723ms to process 1 records I0418 07:52:26.212602 1 tasks_processing.go:74] worker 52 stopped. I0418 07:52:26.212674 1 recorder.go:75] Recording config/authentication with fingerprint=7e6acd6b8773b61bc94f5084ee9f876068d0dd955ece61369934ff241b77292d I0418 07:52:26.212684 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 25.210686ms to process 1 records I0418 07:52:26.213181 1 tasks_processing.go:74] worker 35 stopped. E0418 07:52:26.213194 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0418 07:52:26.213202 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 27.296185ms to process 0 records I0418 07:52:26.213210 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 27.380846ms to process 0 records I0418 07:52:26.213217 1 tasks_processing.go:74] worker 8 stopped. I0418 07:52:26.214313 1 tasks_processing.go:74] worker 1 stopped. I0418 07:52:26.214430 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=6b02df5f96ff51640271e17b479b1e836d42aaec6c18a970da09e953694cf213 I0418 07:52:26.214471 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=86920e872fd5b98ce132b9170a12eb25ee06699eaa245ad1622160f6342898ae I0418 07:52:26.214478 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 29.068824ms to process 2 records I0418 07:52:26.214552 1 tasks_processing.go:74] worker 6 stopped. I0418 07:52:26.217497 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=0d20fae3e00ae68664c7a737401292909e76aae373c59f73c81d50384e8f4c2c I0418 07:52:26.218002 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=5ac88cfc4a5619bb674a0f9452287cfab08aa2e780bf1221f66b3bdd7965e26a I0418 07:52:26.218380 1 gather.go:177] gatherer "clusterconfig" function "crds" took 29.73686ms to process 2 records I0418 07:52:26.218391 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 28.283047ms to process 0 records I0418 07:52:26.218419 1 tasks_processing.go:74] worker 13 stopped. I0418 07:52:26.218486 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=592822be63d824537461844d8a3c3232866474a629a12c5cef14859d9d117724 I0418 07:52:26.218498 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 28.258702ms to process 1 records I0418 07:52:26.218547 1 tasks_processing.go:74] worker 43 stopped. I0418 07:52:26.218612 1 tasks_processing.go:74] worker 27 stopped. I0418 07:52:26.218756 1 recorder.go:75] Recording config/oauth with fingerprint=677c248b8318d0ab6a11146b037d3b18c90716ab8a21efa48efc552b91c8f1a6 I0418 07:52:26.218767 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 28.537944ms to process 1 records I0418 07:52:26.218783 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0418 07:52:26.218792 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 30.066399ms to process 1 records I0418 07:52:26.218864 1 tasks_processing.go:74] worker 3 stopped. I0418 07:52:26.218923 1 tasks_processing.go:74] worker 14 stopped. I0418 07:52:26.219061 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=b2db69386bd79e8bf429c6c34dd96414e085748ee75743c3b571f7d4f8040415 I0418 07:52:26.219170 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=c91bd99d7efbf5296d2edc2563cb078b0966b151e8e3f6ba11ddda2488fb6031 I0418 07:52:26.219206 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ec7fbe2fe0657c8c35f7c32aa8ad1d8d51bfca2008e29ef8e52758e59c644e86 I0418 07:52:26.219248 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=b9aede1db321ba7fba5904b2acaf72c04006472cc2568b60e89637d892a2c9c4 I0418 07:52:26.219274 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=f31d43a88c8e519e785b4387f1f35d3e14d83a20545a61efc368848daebfa479 I0418 07:52:26.219304 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=e7781e4fdd444a0894371354e6bc14a116680b508fd1bed237150ec64f8d3aac I0418 07:52:26.219341 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=067a1bbe0d89b7f2f403a8b9553357dd765e4369fa6e969fa4c826faec084bf8 I0418 07:52:26.219377 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=6966cab0352673794a2428e8d15de9cf80c147a53dfb248cc8e2f73aa8a51d23 I0418 07:52:26.219401 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=6378680d0bce9cd39aa749ad2422b4fa47bb8b99b1096a839c270cbaa138f1ea I0418 07:52:26.219434 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f00c36c8050de0987d98b885f44d0ca32c85e6fa5306d98048e68531604cf5ec I0418 07:52:26.219463 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=bf98a1664081b1e5896b50784c02bc0dac782e5ac1bb2bc54bb16c4afdbc7a7d I0418 07:52:26.219472 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 32.453964ms to process 11 records I0418 07:52:26.219482 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 31.764863ms to process 0 records I0418 07:52:26.219518 1 tasks_processing.go:74] worker 21 stopped. I0418 07:52:26.219578 1 tasks_processing.go:74] worker 58 stopped. I0418 07:52:26.220003 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=3ac80f6523c6bcdc8fa795b0fb0ae88c10edcc4f1588e60e0ca5a9621c585834 I0418 07:52:26.220019 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 33.0024ms to process 1 records I0418 07:52:26.220132 1 tasks_processing.go:74] worker 57 stopped. I0418 07:52:26.220318 1 recorder.go:75] Recording config/node/ip-10-0-0-123.ec2.internal with fingerprint=eeb13d55db8204e45724cd62a54e5c0e0f7af1c5b54b6d6b8fb8d018a4bb165b I0418 07:52:26.220403 1 recorder.go:75] Recording config/node/ip-10-0-2-176.ec2.internal with fingerprint=c2aa9d0acb7d4bfec1f6406f4496f7b83e2ac0ae40f7a502cef0b08c5ff4cd6b I0418 07:52:26.220418 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 33.806507ms to process 2 records I0418 07:52:26.220426 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 32.109925ms to process 0 records I0418 07:52:26.220435 1 tasks_processing.go:74] worker 20 stopped. I0418 07:52:26.221108 1 tasks_processing.go:74] worker 33 stopped. I0418 07:52:26.221127 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 34.465887ms to process 0 records I0418 07:52:26.221533 1 tasks_processing.go:74] worker 26 stopped. I0418 07:52:26.221696 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=f58ced925ff1f2f80bd749176881e9ec0be6667ba41c6883af3fdcd1b8aee0f9 I0418 07:52:26.221743 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=9172019bab34ab5b66d71bad4100e8ab7adf168c9e6e65e25a9706bde954353f I0418 07:52:26.221777 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=35b454017fe3d1a43425087d4304bfb062ac935dabbbbe9c1f6939f853f2cf89 I0418 07:52:26.221789 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 35.564194ms to process 3 records I0418 07:52:26.221865 1 recorder.go:75] Recording config/image with fingerprint=47010ca1d17f2e1d052e8ae6738c550cd99700c8fe21242200c3da0f62c34d39 I0418 07:52:26.221874 1 tasks_processing.go:74] worker 51 stopped. I0418 07:52:26.221876 1 gather.go:177] gatherer "clusterconfig" function "image" took 34.777711ms to process 1 records E0418 07:52:26.221888 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0418 07:52:26.221894 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 35.940486ms to process 0 records I0418 07:52:26.221940 1 tasks_processing.go:74] worker 25 stopped. I0418 07:52:26.221994 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=fc4e852375c17bcc6a7eca895b970bc85faf82fe16b3cf3d1fc837bd5d8d17b3 I0418 07:52:26.222002 1 tasks_processing.go:74] worker 48 stopped. I0418 07:52:26.222019 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=5c673ca137633c514d840ace26f309e55b4e7653596070b364b62c245f9cf86a I0418 07:52:26.222042 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=5130be6453cf82bf20e547af2c0851f3983cec24d9a38bb433d9134f49923a53 I0418 07:52:26.222054 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 35.033576ms to process 3 records I0418 07:52:26.222209 1 tasks_processing.go:74] worker 41 stopped. I0418 07:52:26.222207 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0418 07:52:26.222283 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0418 07:52:26.222363 1 operator.go:288] started I0418 07:52:26.222390 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0418 07:52:26.222523 1 recorder.go:75] Recording config/ingress with fingerprint=41320043b4a8b57f7b740b8ad3fbe8182505147d28027681001851ab117139d9 I0418 07:52:26.222543 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 36.006467ms to process 1 records I0418 07:52:26.222551 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 35.98382ms to process 0 records I0418 07:52:26.222559 1 tasks_processing.go:74] worker 53 stopped. I0418 07:52:26.222618 1 tasks_processing.go:74] worker 19 stopped. I0418 07:52:26.222761 1 recorder.go:75] Recording config/featuregate with fingerprint=3a8ba3e34078be5cb1a2093a9d55059b2cb314b381a7336b3cb3cabb8d2e875c I0418 07:52:26.222785 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 36.821104ms to process 1 records I0418 07:52:26.222799 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 38.084186ms to process 0 records I0418 07:52:26.222808 1 tasks_processing.go:74] worker 22 stopped. W0418 07:52:26.223612 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 07:52:26.225353 1 tasks_processing.go:74] worker 9 stopped. I0418 07:52:26.225577 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=f7e8967bbc29dcf8837f00474c5c73fff4bb79d20551a6dc1fecd2e0f0d75a55 I0418 07:52:26.225682 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=c35b2e0a84d79716bfc3e0d0467a5c9c35e2e847c3dcca48e741169f2a6042b7 I0418 07:52:26.225695 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 40.098014ms to process 2 records I0418 07:52:26.229376 1 tasks_processing.go:74] worker 28 stopped. I0418 07:52:26.229395 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 44.761653ms to process 0 records I0418 07:52:26.231970 1 tasks_processing.go:74] worker 32 stopped. I0418 07:52:26.232058 1 recorder.go:75] Recording config/running_containers with fingerprint=a30be70de148086ee9de7a8d403d18ccec33f175d4325a30ae8f5870f448e24f I0418 07:52:26.232075 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 47.471741ms to process 1 records I0418 07:52:26.232454 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0418 07:52:26.232466 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0418 07:52:26.232470 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0418 07:52:26.232474 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0418 07:52:26.232477 1 controller.go:212] Source scaController *sca.Controller is not ready I0418 07:52:26.232492 1 controller.go:489] The operator is still being initialized I0418 07:52:26.232497 1 controller.go:512] The operator is healthy I0418 07:52:26.237251 1 prometheus_rules.go:88] Prometheus rules successfully created I0418 07:52:26.237529 1 tasks_processing.go:74] worker 7 stopped. I0418 07:52:26.237544 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 52.913675ms to process 0 records E0418 07:52:26.243474 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27552ea46f-895a-41a4-b70f-0a2a6cb14274%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:55555->172.30.0.10:53: read: connection refused I0418 07:52:26.243487 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27552ea46f-895a-41a4-b70f-0a2a6cb14274%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:55555->172.30.0.10:53: read: connection refused I0418 07:52:26.252344 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0418 07:52:26.252354 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0418 07:52:26.252369 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0418 07:52:26.253185 1 tasks_processing.go:74] worker 45 stopped. I0418 07:52:26.253281 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=bc5837b5578fdad20a8b8a29c1516389fd7561a3fad87abad55b73e9b3b7c5ce I0418 07:52:26.253297 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 67.864383ms to process 1 records I0418 07:52:26.255934 1 tasks_processing.go:74] worker 40 stopped. E0418 07:52:26.255999 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0418 07:52:26.256013 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0418 07:52:26.256019 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0418 07:52:26.256032 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0418 07:52:26.256077 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0418 07:52:26.256087 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0418 07:52:26.256100 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0418 07:52:26.256107 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0418 07:52:26.256161 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0418 07:52:26.256172 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0418 07:52:26.256180 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 70.462978ms to process 7 records I0418 07:52:26.256209 1 base_controller.go:82] Caches are synced for ConfigController I0418 07:52:26.256250 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0418 07:52:26.262491 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 07:52:26.272958 1 tasks_processing.go:74] worker 5 stopped. I0418 07:52:26.272972 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 87.834304ms to process 0 records I0418 07:52:26.293343 1 tasks_processing.go:74] worker 59 stopped. I0418 07:52:26.293622 1 recorder.go:75] Recording config/version with fingerprint=168d72255a0f3e8cbab674458e265b9974b315ad2fe5616e0194e9de81a2fa6e I0418 07:52:26.293634 1 recorder.go:75] Recording config/id with fingerprint=67e25a76ab67519efe69d10c22f64d838b8b7cf9700588de6912bd518aa41580 I0418 07:52:26.293641 1 gather.go:177] gatherer "clusterconfig" function "version" took 108.701131ms to process 2 records I0418 07:52:26.313612 1 tasks_processing.go:74] worker 39 stopped. I0418 07:52:26.313638 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0418 07:52:26.313647 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 128.315566ms to process 1 records I0418 07:52:26.320046 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0418 07:52:26.322580 1 base_controller.go:82] Caches are synced for LoggingSyncer I0418 07:52:26.322592 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... W0418 07:52:26.324105 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:35598->172.30.0.10:53: read: connection refused I0418 07:52:26.324121 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:35598->172.30.0.10:53: read: connection refused I0418 07:52:26.330945 1 tasks_processing.go:74] worker 10 stopped. E0418 07:52:26.330959 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0418 07:52:26.330966 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2poebv4lqpsihskk0anl4qje6l4tp2si-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2poebv4lqpsihskk0anl4qje6l4tp2si-primary-cert-bundle-secret" not found I0418 07:52:26.331022 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=7aadefeac81cda141076fd12083417e1a1edeba688c187867df434aab00e2e64 I0418 07:52:26.331035 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 145.57853ms to process 1 records I0418 07:52:26.631058 1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 16 containers I0418 07:52:26.631072 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1572864 bytes I0418 07:52:26.632357 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-57qpw pod in namespace openshift-dns (previous: false). I0418 07:52:26.885467 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-57qpw pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-57qpw\" is waiting to start: ContainerCreating" I0418 07:52:26.885484 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-57qpw\" is waiting to start: ContainerCreating" I0418 07:52:26.885493 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-57qpw pod in namespace openshift-dns (previous: false). I0418 07:52:27.042632 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-57qpw pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-57qpw\" is waiting to start: ContainerCreating" I0418 07:52:27.042652 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-57qpw\" is waiting to start: ContainerCreating" I0418 07:52:27.042688 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-ppcbn pod in namespace openshift-dns (previous: false). W0418 07:52:27.218793 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 07:52:27.266523 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-ppcbn pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-ppcbn\" is waiting to start: ContainerCreating" I0418 07:52:27.266540 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-ppcbn\" is waiting to start: ContainerCreating" I0418 07:52:27.266547 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-ppcbn pod in namespace openshift-dns (previous: false). I0418 07:52:27.437187 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-ppcbn pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-ppcbn\" is waiting to start: ContainerCreating" I0418 07:52:27.437203 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-ppcbn\" is waiting to start: ContainerCreating" I0418 07:52:27.437213 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-8fb4n pod in namespace openshift-dns (previous: false). I0418 07:52:27.637026 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 07:52:27.637043 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-cf4l7 pod in namespace openshift-dns (previous: false). I0418 07:52:27.658805 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0418 07:52:27.837015 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 07:52:27.837032 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6b9bf64784-jpzb9 pod in namespace openshift-image-registry (previous: false). I0418 07:52:28.038339 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6b9bf64784-jpzb9 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6b9bf64784-jpzb9\" is waiting to start: ContainerCreating" I0418 07:52:28.038354 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6b9bf64784-jpzb9\" is waiting to start: ContainerCreating" I0418 07:52:28.038364 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6b9bf64784-rjwcp pod in namespace openshift-image-registry (previous: false). W0418 07:52:28.218740 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 07:52:28.236914 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6b9bf64784-rjwcp pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6b9bf64784-rjwcp\" is waiting to start: ContainerCreating" I0418 07:52:28.236928 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6b9bf64784-rjwcp\" is waiting to start: ContainerCreating" I0418 07:52:28.236938 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-9f65788f9-pxnrr pod in namespace openshift-image-registry (previous: false). I0418 07:52:28.247680 1 tasks_processing.go:74] worker 62 stopped. I0418 07:52:28.247730 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=5f84a3c0f060ff5337fd503fb9221f823a8e627a5d7d8b2b5d3c78d4c8bc8de5 I0418 07:52:28.247764 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=04684f2adc5ee868a7b4a775e04cecf46e7681ed9c4679ae5098db25e8e08f7b I0418 07:52:28.247794 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0418 07:52:28.247819 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=886772e3707a3e5eb182dde0b9ca10640f62b33ddcdaefcd20e0812dcc270eeb I0418 07:52:28.247837 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0418 07:52:28.247858 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=6e13fecc898a9d9488cdf8779561f0f1a8e019bc4d006b4ea351f69724fa9fb9 I0418 07:52:28.247892 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=3b6e0f8100cc5bfabf48398e768b88c82ff8fd86dc51657d83959ab4f07c16e4 I0418 07:52:28.247946 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=98da3195f7970d23e28d5db6fc30a746e69399600842c2bcf20782589c9d77a1 I0418 07:52:28.247961 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=4eff61149579eb46fa6708edbc9df1177fc7803f7b195c7c6889be31eb75b23b I0418 07:52:28.247978 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a12af19e1c5cdde4fbb8b69abb1ace9d8a6f465a0b4becc6ef7d37dcbb43f899 I0418 07:52:28.247987 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0418 07:52:28.248003 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=bea7fca1956b20860fafddd1e7921bfb14ba48416df0f657dead3541cb327413 I0418 07:52:28.248013 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0418 07:52:28.248028 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=00827142dcb95dcdcbf7470b601ccc1e1e8432ae59d923438b470043fcab1881 I0418 07:52:28.248037 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0418 07:52:28.248050 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=0e7869dc2bd9802a512766f62aaaf9dc8fe2c058126876e6364b7055a3182d91 I0418 07:52:28.248059 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0418 07:52:28.248074 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=b20341ac8f80ca4da8982b6bdd3412621f37c1efe8e8e82c4c07dbbed5b961ae I0418 07:52:28.248197 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=251d2467044413701b6c8876a5f3b9174596ed3f2a098b3ba0225bbe6ecc9048 I0418 07:52:28.248207 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0418 07:52:28.248213 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0418 07:52:28.248232 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0418 07:52:28.248252 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=f2543e1cdb609ca5d67be0d10b62817a2afb0c9c78e1148c3fbe095c7cb4d0f3 I0418 07:52:28.248276 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=88ba19eb3f045dee857f50d762a517e894a79358d3f4072492990521832dde0c I0418 07:52:28.248285 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0418 07:52:28.248301 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=51f47bbd5fd32dbb3be902de5b9e29bec186924ba95f44b93a8d173285512337 I0418 07:52:28.248311 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0418 07:52:28.248326 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=a14f8e7588de3d70b8b26221fe5a889ab1e1bdd69863757158f924935488618e I0418 07:52:28.248340 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=3b3b5b4352015032981d8e0c7b8b158e856694ca92746169961f98033a40a66c I0418 07:52:28.248354 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=b99a16e2e5ba37fe43c1227ff9f748f9a34104762d4a6e84c1d55f10a2e998c7 I0418 07:52:28.248369 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=c930341d5797fe2e7c76629d234912fdc5836ed0512fdd9bc6ca4e1ec194c63d I0418 07:52:28.248390 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=58f40a72188d6cbb2417196f436996e988a5b8177685bee23776f7b9369a6078 I0418 07:52:28.248399 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0418 07:52:28.248427 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=9fadde2a8ed56a936801cb78b6f078c61887db36b2db955423040ee43692d117 I0418 07:52:28.248441 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0418 07:52:28.248449 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0418 07:52:28.248457 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.060720113s to process 36 records I0418 07:52:28.430788 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 07:52:28.430807 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-42pp5 pod in namespace openshift-image-registry (previous: false). I0418 07:52:28.638122 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 07:52:28.638139 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-k86hf pod in namespace openshift-image-registry (previous: false). I0418 07:52:28.837618 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 07:52:28.837634 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6dbdfd96f4-g6tqd pod in namespace openshift-ingress (previous: false). I0418 07:52:29.038017 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6dbdfd96f4-g6tqd pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6dbdfd96f4-g6tqd\" is waiting to start: ContainerCreating" I0418 07:52:29.038031 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6dbdfd96f4-g6tqd\" is waiting to start: ContainerCreating" I0418 07:52:29.038042 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6dbdfd96f4-tnmvp pod in namespace openshift-ingress (previous: false). W0418 07:52:29.219357 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 07:52:29.237041 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6dbdfd96f4-tnmvp pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6dbdfd96f4-tnmvp\" is waiting to start: ContainerCreating" I0418 07:52:29.237053 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6dbdfd96f4-tnmvp\" is waiting to start: ContainerCreating" I0418 07:52:29.237063 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7887dcf549-wjtnt pod in namespace openshift-ingress (previous: false). I0418 07:52:29.319422 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 07:52:29.439996 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7887dcf549-wjtnt pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7887dcf549-wjtnt\" is waiting to start: ContainerCreating" I0418 07:52:29.440023 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7887dcf549-wjtnt\" is waiting to start: ContainerCreating" I0418 07:52:29.440034 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-44pg4 pod in namespace openshift-ingress-canary (previous: false). I0418 07:52:29.640252 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-44pg4 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-44pg4\" is waiting to start: ContainerCreating" I0418 07:52:29.640269 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-44pg4\" is waiting to start: ContainerCreating" I0418 07:52:29.640279 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-xc9pd pod in namespace openshift-ingress-canary (previous: false). I0418 07:52:29.850709 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-xc9pd pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xc9pd\" is waiting to start: ContainerCreating" I0418 07:52:29.850724 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xc9pd\" is waiting to start: ContainerCreating" I0418 07:52:29.850740 1 tasks_processing.go:74] worker 0 stopped. I0418 07:52:29.850827 1 recorder.go:75] Recording events/openshift-dns with fingerprint=e59d9812161556c6c83004a2254fe2cda39f1b822c9468bae7d13cd4cbfabb61 I0418 07:52:29.850927 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=0fcb99ec59837e951cb0daf4caa88758f5ca65f76b041b18d860f6392413865e I0418 07:52:29.850956 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=9d775a3557fec336c160335933658dfa86910697a46d9b0ef0c70a7073b475f4 I0418 07:52:29.851002 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=b819a73f3f99f8bb3a1a4b46c35f42a4712da44f7f9fafd92c21abebf728a910 I0418 07:52:29.851018 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=5dc966303ea51cdd85f00918bbe15aa6150ba73268f28b2d9fa852baf289f81a I0418 07:52:29.851025 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.664981765s to process 5 records W0418 07:52:30.219300 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0418 07:52:31.218931 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0418 07:52:31.218952 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0418 07:52:31.218968 1 tasks_processing.go:74] worker 23 stopped. E0418 07:52:31.218979 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0418 07:52:31.219009 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0418 07:52:31.219023 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0418 07:52:31.219033 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.032341821s to process 1 records I0418 07:52:38.700842 1 tasks_processing.go:74] worker 38 stopped. I0418 07:52:38.700878 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0418 07:52:38.700890 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.515336924s to process 1 records I0418 07:52:39.393743 1 tasks_processing.go:74] worker 31 stopped. I0418 07:52:39.394005 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=5f3315562ab922847b80910efb7b38b1b30885aa3cdda0895bd6e02e66f43fde I0418 07:52:39.394021 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.208382082s to process 1 records E0418 07:52:39.394085 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.209s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0418 07:52:39.395187 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0418 07:52:39.395201 1 periodic.go:209] Running workloads gatherer I0418 07:52:39.395215 1 tasks_processing.go:45] number of workers: 2 I0418 07:52:39.395221 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 07:52:39.395225 1 tasks_processing.go:71] worker 1 working on workload_info task. I0418 07:52:39.395240 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 07:52:39.395256 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0418 07:52:39.417295 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 20s for image data I0418 07:52:39.420053 1 tasks_processing.go:74] worker 0 stopped. I0418 07:52:39.420069 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.784951ms to process 0 records I0418 07:52:39.426777 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (10ms) I0418 07:52:39.435848 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0418 07:52:39.447968 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (12ms) I0418 07:52:39.459172 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (11ms) I0418 07:52:39.467994 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (9ms) I0418 07:52:39.476658 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (9ms) I0418 07:52:39.485582 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (9ms) I0418 07:52:39.496504 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (11ms) I0418 07:52:39.505345 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (9ms) I0418 07:52:39.514470 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (9ms) I0418 07:52:39.526673 1 gather_workloads_info.go:387] No image sha256:bffebf689df67af02a06b97d3d9bfcfdccd597350d132171ee68f3d0ed29a3f6 (12ms) I0418 07:52:39.626614 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0418 07:52:39.727567 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (101ms) I0418 07:52:39.827856 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (100ms) I0418 07:52:39.926958 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (99ms) I0418 07:52:40.027474 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0418 07:52:40.128234 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (101ms) I0418 07:52:40.228258 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms) I0418 07:52:40.327446 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (99ms) I0418 07:52:40.427950 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0418 07:52:40.527195 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (99ms) I0418 07:52:40.627477 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (100ms) I0418 07:52:40.726880 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (99ms) I0418 07:52:40.826958 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0418 07:52:40.926959 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0418 07:52:41.027526 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (101ms) I0418 07:52:41.127879 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0418 07:52:41.227134 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (99ms) I0418 07:52:41.327050 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0418 07:52:41.426995 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0418 07:52:41.527090 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (100ms) I0418 07:52:41.627090 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0418 07:52:41.727182 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0418 07:52:41.827129 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0418 07:52:41.827156 1 tasks_processing.go:74] worker 1 stopped. E0418 07:52:41.827166 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0418 07:52:41.827395 1 recorder.go:75] Recording config/workload_info with fingerprint=747aa0c51957034ce80a946254da8e74ae10e4012bd78bb4461b108ce9d36d31 I0418 07:52:41.827409 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.431925121s to process 1 records E0418 07:52:41.827431 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.432s with: function \"workload_info\" failed with an error" I0418 07:52:41.828530 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0418 07:52:41.828542 1 periodic.go:209] Running conditional gatherer I0418 07:52:41.834654 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0418 07:52:41.841070 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:53839->172.30.0.10:53: read: connection refused E0418 07:52:41.841301 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 07:52:41.841358 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0418 07:52:41.848357 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0418 07:52:41.848371 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 07:52:41.848377 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 07:52:41.848382 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 07:52:41.848386 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 07:52:41.848390 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 07:52:41.848393 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 07:52:41.848396 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 07:52:41.848399 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 07:52:41.848402 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0418 07:52:41.848418 1 tasks_processing.go:45] number of workers: 3 I0418 07:52:41.848431 1 tasks_processing.go:69] worker 2 listening for tasks. I0418 07:52:41.848435 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0418 07:52:41.848439 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 07:52:41.848447 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 07:52:41.848465 1 tasks_processing.go:74] worker 1 stopped. I0418 07:52:41.848479 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0418 07:52:41.848478 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0418 07:52:41.848515 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0418 07:52:41.848528 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 860ns to process 1 records I0418 07:52:41.848564 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0418 07:52:41.848573 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.132µs to process 1 records I0418 07:52:41.848579 1 tasks_processing.go:74] worker 0 stopped. I0418 07:52:41.848726 1 tasks_processing.go:74] worker 2 stopped. I0418 07:52:41.848736 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 236.691µs to process 0 records I0418 07:52:41.848763 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:53839->172.30.0.10:53: read: connection refused I0418 07:52:41.848778 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0418 07:52:41.871210 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=523488b9cbd29bc4dd498e394e87ede355d564d00fe80ed886e7384935a25d67 I0418 07:52:41.871320 1 diskrecorder.go:70] Writing 98 records to /var/lib/insights-operator/insights-2026-04-18-075241.tar.gz I0418 07:52:41.876798 1 diskrecorder.go:51] Wrote 98 records to disk in 5ms I0418 07:52:41.876824 1 periodic.go:278] Gathering cluster info every 2h0m0s I0418 07:52:41.876836 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0418 07:52:41.896602 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 07:52:42.100718 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 07:52:53.948031 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 07:53:55.351569 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="baef9268c14e497b6efff7dcf6a16e6a9590db2611c630806728ed2639fe3af4") W0418 07:53:55.351599 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0418 07:53:55.351643 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="af477bf4421b67528f2a9feb68cc26e592b1a0caef59d45cfb9dab13603b9c08") I0418 07:53:55.351671 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0418 07:53:55.351691 1 base_controller.go:181] Shutting down LoggingSyncer ... I0418 07:53:55.351714 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0418 07:53:55.351720 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="6d5e4893fa8b85d833a5ee33f49688f1c2ad335b359ead50ca200d13b2ab927a") I0418 07:53:55.351723 1 periodic.go:170] Shutting down I0418 07:53:55.351724 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0418 07:53:55.351749 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0418 07:53:55.351770 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0418 07:53:55.351773 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0418 07:53:55.351777 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain"