W0425 19:02:44.717624 1 cmd.go:257] Using insecure, self-signed certificates I0425 19:02:45.119190 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 19:02:45.119501 1 observer_polling.go:159] Starting file observer I0425 19:02:45.934416 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0425 19:02:45.934621 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0425 19:02:45.935176 1 secure_serving.go:57] Forcing use of http/1.1 only W0425 19:02:45.935204 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. I0425 19:02:45.935209 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0425 19:02:45.935211 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0425 19:02:45.935237 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0425 19:02:45.935244 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0425 19:02:45.935249 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0425 19:02:45.935252 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0425 19:02:45.938860 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0425 19:02:45.938879 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"2b0185b6-64e8-49a6-be4c-a0387269f47c", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0425 19:02:45.941683 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0425 19:02:45.941706 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0425 19:02:45.941699 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0425 19:02:45.941705 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0425 19:02:45.941720 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0425 19:02:45.941727 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0425 19:02:45.941995 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1273683707/tls.crt::/tmp/serving-cert-1273683707/tls.key" I0425 19:02:45.942251 1 secure_serving.go:213] Serving securely on [::]:8443 I0425 19:02:45.942282 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0425 19:02:45.946113 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0425 19:02:45.946135 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0425 19:02:45.946259 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0425 19:02:45.951833 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 19:02:45.951856 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0425 19:02:45.958686 1 secretconfigobserver.go:119] support secret does not exist I0425 19:02:45.963026 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 19:02:45.967140 1 secretconfigobserver.go:119] support secret does not exist I0425 19:02:45.969600 1 recorder.go:161] Pruning old reports every 4h13m17s, max age is 288h0m0s I0425 19:02:45.973637 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0425 19:02:45.973645 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0425 19:02:45.973654 1 insightsreport.go:296] Starting report retriever I0425 19:02:45.973656 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0425 19:02:45.973660 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0425 19:02:45.973683 1 periodic.go:209] Running clusterconfig gatherer I0425 19:02:45.973732 1 tasks_processing.go:45] number of workers: 64 I0425 19:02:45.973775 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 19:02:45.973786 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 19:02:45.973796 1 tasks_processing.go:69] worker 13 listening for tasks. I0425 19:02:45.973801 1 tasks_processing.go:71] worker 0 working on lokistack task. I0425 19:02:45.973804 1 tasks_processing.go:69] worker 9 listening for tasks. I0425 19:02:45.973814 1 tasks_processing.go:71] worker 9 working on openstack_dataplanedeployments task. I0425 19:02:45.973823 1 tasks_processing.go:69] worker 18 listening for tasks. I0425 19:02:45.973824 1 tasks_processing.go:69] worker 11 listening for tasks. I0425 19:02:45.973817 1 tasks_processing.go:69] worker 5 listening for tasks. I0425 19:02:45.973833 1 tasks_processing.go:69] worker 12 listening for tasks. I0425 19:02:45.973837 1 tasks_processing.go:69] worker 2 listening for tasks. I0425 19:02:45.973843 1 tasks_processing.go:69] worker 16 listening for tasks. I0425 19:02:45.973839 1 tasks_processing.go:69] worker 7 listening for tasks. I0425 19:02:45.973851 1 tasks_processing.go:69] worker 17 listening for tasks. I0425 19:02:45.973852 1 tasks_processing.go:69] worker 4 listening for tasks. I0425 19:02:45.973853 1 tasks_processing.go:69] worker 15 listening for tasks. I0425 19:02:45.973841 1 tasks_processing.go:69] worker 14 listening for tasks. I0425 19:02:45.973862 1 tasks_processing.go:71] worker 4 working on overlapping_namespace_uids task. I0425 19:02:45.973866 1 tasks_processing.go:69] worker 19 listening for tasks. I0425 19:02:45.973866 1 tasks_processing.go:71] worker 14 working on machine_config_pools task. I0425 19:02:45.973863 1 tasks_processing.go:69] worker 8 listening for tasks. I0425 19:02:45.973873 1 tasks_processing.go:71] worker 18 working on aggregated_monitoring_cr_names task. I0425 19:02:45.973876 1 tasks_processing.go:69] worker 31 listening for tasks. I0425 19:02:45.973878 1 tasks_processing.go:69] worker 20 listening for tasks. I0425 19:02:45.973882 1 tasks_processing.go:69] worker 32 listening for tasks. I0425 19:02:45.973886 1 tasks_processing.go:71] worker 20 working on feature_gates task. I0425 19:02:45.973883 1 tasks_processing.go:71] worker 31 working on storage_classes task. I0425 19:02:45.973883 1 tasks_processing.go:71] worker 12 working on olm_operators task. I0425 19:02:45.973899 1 tasks_processing.go:69] worker 35 listening for tasks. I0425 19:02:45.973904 1 tasks_processing.go:69] worker 36 listening for tasks. I0425 19:02:45.973871 1 tasks_processing.go:71] worker 19 working on dvo_metrics task. I0425 19:02:45.973910 1 tasks_processing.go:69] worker 37 listening for tasks. I0425 19:02:45.973906 1 tasks_processing.go:69] worker 25 listening for tasks. I0425 19:02:45.973919 1 tasks_processing.go:69] worker 39 listening for tasks. I0425 19:02:45.973915 1 tasks_processing.go:69] worker 38 listening for tasks. I0425 19:02:45.973925 1 tasks_processing.go:69] worker 40 listening for tasks. I0425 19:02:45.973871 1 tasks_processing.go:69] worker 30 listening for tasks. I0425 19:02:45.973889 1 tasks_processing.go:69] worker 33 listening for tasks. I0425 19:02:45.973935 1 tasks_processing.go:71] worker 7 working on version task. I0425 19:02:45.973861 1 tasks_processing.go:71] worker 15 working on machine_sets task. I0425 19:02:45.973944 1 tasks_processing.go:69] worker 24 listening for tasks. I0425 19:02:45.973948 1 tasks_processing.go:69] worker 21 listening for tasks. I0425 19:02:45.973946 1 tasks_processing.go:71] worker 16 working on silenced_alerts task. I0425 19:02:45.973956 1 tasks_processing.go:71] worker 2 working on openshift_machine_api_events task. I0425 19:02:45.973962 1 tasks_processing.go:69] worker 54 listening for tasks. I0425 19:02:45.973971 1 tasks_processing.go:69] worker 55 listening for tasks. I0425 19:02:45.973979 1 tasks_processing.go:69] worker 56 listening for tasks. I0425 19:02:45.973987 1 tasks_processing.go:69] worker 57 listening for tasks. I0425 19:02:45.973994 1 tasks_processing.go:69] worker 58 listening for tasks. W0425 19:02:45.973991 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 19:02:45.974004 1 tasks_processing.go:69] worker 63 listening for tasks. I0425 19:02:45.974011 1 tasks_processing.go:71] worker 1 working on operators task. I0425 19:02:45.974022 1 tasks_processing.go:69] worker 29 listening for tasks. I0425 19:02:45.974039 1 tasks_processing.go:69] worker 26 listening for tasks. I0425 19:02:45.973868 1 tasks_processing.go:71] worker 11 working on networks task. I0425 19:02:45.974048 1 tasks_processing.go:69] worker 27 listening for tasks. I0425 19:02:45.973936 1 tasks_processing.go:69] worker 22 listening for tasks. I0425 19:02:45.973878 1 tasks_processing.go:71] worker 8 working on pdbs task. I0425 19:02:45.974062 1 tasks_processing.go:69] worker 28 listening for tasks. I0425 19:02:45.974072 1 tasks_processing.go:71] worker 5 working on ingress task. I0425 19:02:45.973811 1 tasks_processing.go:69] worker 10 listening for tasks. I0425 19:02:45.974092 1 tasks_processing.go:69] worker 62 listening for tasks. I0425 19:02:45.974102 1 tasks_processing.go:69] worker 47 listening for tasks. I0425 19:02:45.974108 1 tasks_processing.go:69] worker 60 listening for tasks. I0425 19:02:45.974118 1 tasks_processing.go:69] worker 61 listening for tasks. I0425 19:02:45.973861 1 tasks_processing.go:69] worker 41 listening for tasks. I0425 19:02:45.974010 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 41.985µs to process 0 records I0425 19:02:45.973848 1 tasks_processing.go:69] worker 3 listening for tasks. I0425 19:02:45.973893 1 tasks_processing.go:69] worker 34 listening for tasks. I0425 19:02:45.974138 1 tasks_processing.go:71] worker 17 working on machine_healthchecks task. I0425 19:02:45.974297 1 tasks_processing.go:71] worker 41 working on proxies task. I0425 19:02:45.974409 1 tasks_processing.go:71] worker 34 working on pod_network_connectivity_checks task. I0425 19:02:45.974451 1 tasks_processing.go:71] worker 3 working on crds task. I0425 19:02:45.974159 1 tasks_processing.go:71] worker 61 working on image_registries task. I0425 19:02:45.974163 1 tasks_processing.go:71] worker 32 working on nodenetworkconfigurationpolicies task. I0425 19:02:45.974167 1 tasks_processing.go:71] worker 35 working on sap_datahubs task. I0425 19:02:45.973934 1 tasks_processing.go:69] worker 23 listening for tasks. I0425 19:02:45.974583 1 tasks_processing.go:69] worker 53 listening for tasks. I0425 19:02:45.974171 1 tasks_processing.go:71] worker 36 working on monitoring_persistent_volumes task. I0425 19:02:45.974625 1 tasks_processing.go:71] worker 53 working on openstack_version task. I0425 19:02:45.974176 1 tasks_processing.go:71] worker 37 working on config_maps task. I0425 19:02:45.974180 1 tasks_processing.go:71] worker 25 working on jaegers task. I0425 19:02:45.974186 1 tasks_processing.go:71] worker 39 working on install_plans task. I0425 19:02:45.974189 1 tasks_processing.go:71] worker 38 working on nodes task. I0425 19:02:45.974193 1 tasks_processing.go:71] worker 40 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0425 19:02:45.974197 1 tasks_processing.go:71] worker 30 working on certificate_signing_requests task. I0425 19:02:45.974201 1 tasks_processing.go:71] worker 33 working on sap_pods task. I0425 19:02:45.974207 1 tasks_processing.go:71] worker 24 working on openshift_logging task. I0425 19:02:45.974210 1 tasks_processing.go:71] worker 26 working on node_logs task. I0425 19:02:45.974213 1 tasks_processing.go:71] worker 29 working on mutating_webhook_configurations task. I0425 19:02:45.974214 1 tasks_processing.go:71] worker 27 working on sap_config task. I0425 19:02:45.974219 1 tasks_processing.go:71] worker 62 working on container_images task. I0425 19:02:45.974219 1 tasks_processing.go:71] worker 21 working on metrics task. I0425 19:02:45.974220 1 tasks_processing.go:71] worker 10 working on tsdb_status task. W0425 19:02:45.975583 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 19:02:45.975595 1 tasks_processing.go:71] worker 21 working on authentication task. I0425 19:02:45.974223 1 tasks_processing.go:71] worker 47 working on operators_pods_and_events task. W0425 19:02:45.975602 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 19:02:45.974224 1 tasks_processing.go:71] worker 54 working on active_alerts task. I0425 19:02:45.975620 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 33.091µs to process 0 records I0425 19:02:45.975637 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 28.514µs to process 0 records I0425 19:02:45.975648 1 tasks_processing.go:71] worker 10 working on support_secret task. W0425 19:02:45.975652 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 19:02:45.974225 1 tasks_processing.go:71] worker 22 working on machine_configs task. I0425 19:02:45.975722 1 tasks_processing.go:71] worker 54 working on validating_webhook_configurations task. I0425 19:02:45.975722 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 88.027µs to process 0 records I0425 19:02:45.974231 1 tasks_processing.go:71] worker 55 working on cluster_apiserver task. I0425 19:02:45.974226 1 tasks_processing.go:71] worker 60 working on nodenetworkstates task. I0425 19:02:45.974234 1 tasks_processing.go:71] worker 56 working on openstack_dataplanenodesets task. I0425 19:02:45.974238 1 tasks_processing.go:71] worker 57 working on ingress_certificates task. I0425 19:02:45.974230 1 tasks_processing.go:71] worker 28 working on container_runtime_configs task. I0425 19:02:45.973803 1 tasks_processing.go:71] worker 13 working on cost_management_metrics_configs task. I0425 19:02:45.974242 1 tasks_processing.go:71] worker 58 working on image_pruners task. I0425 19:02:45.974244 1 tasks_processing.go:69] worker 50 listening for tasks. I0425 19:02:45.974244 1 tasks_processing.go:69] worker 42 listening for tasks. I0425 19:02:45.974244 1 tasks_processing.go:71] worker 16 working on clusterroles task. I0425 19:02:45.976215 1 tasks_processing.go:71] worker 42 working on oauths task. I0425 19:02:45.974245 1 tasks_processing.go:71] worker 63 working on qemu_kubevirt_launcher_logs task. I0425 19:02:45.974253 1 tasks_processing.go:69] worker 43 listening for tasks. I0425 19:02:45.976365 1 tasks_processing.go:71] worker 43 working on image task. I0425 19:02:45.974254 1 tasks_processing.go:69] worker 48 listening for tasks. I0425 19:02:45.974263 1 tasks_processing.go:69] worker 44 listening for tasks. I0425 19:02:45.974259 1 tasks_processing.go:69] worker 49 listening for tasks. I0425 19:02:45.976394 1 tasks_processing.go:71] worker 44 working on storage_cluster task. I0425 19:02:45.974263 1 tasks_processing.go:69] worker 51 listening for tasks. I0425 19:02:45.976407 1 tasks_processing.go:71] worker 51 working on openstack_controlplanes task. I0425 19:02:45.974265 1 tasks_processing.go:69] worker 52 listening for tasks. I0425 19:02:45.974270 1 tasks_processing.go:69] worker 46 listening for tasks. I0425 19:02:45.974268 1 tasks_processing.go:69] worker 45 listening for tasks. I0425 19:02:45.973851 1 tasks_processing.go:69] worker 6 listening for tasks. I0425 19:02:45.973954 1 tasks_processing.go:69] worker 59 listening for tasks. I0425 19:02:45.974618 1 tasks_processing.go:71] worker 23 working on infrastructures task. I0425 19:02:45.976474 1 tasks_processing.go:74] worker 45 stopped. I0425 19:02:45.976481 1 tasks_processing.go:71] worker 52 working on service_accounts task. I0425 19:02:45.976495 1 tasks_processing.go:71] worker 46 working on machines task. I0425 19:02:45.976496 1 tasks_processing.go:74] worker 59 stopped. I0425 19:02:45.976506 1 tasks_processing.go:74] worker 6 stopped. I0425 19:02:45.976202 1 tasks_processing.go:71] worker 50 working on machine_autoscalers task. I0425 19:02:45.976388 1 tasks_processing.go:71] worker 48 working on ceph_cluster task. I0425 19:02:45.976398 1 tasks_processing.go:71] worker 49 working on schedulers task. I0425 19:02:45.977966 1 tasks_processing.go:74] worker 0 stopped. I0425 19:02:45.977980 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 4.155963ms to process 0 records I0425 19:02:45.977997 1 tasks_processing.go:74] worker 15 stopped. I0425 19:02:45.978011 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 4.04827ms to process 0 records I0425 19:02:45.978060 1 tasks_processing.go:74] worker 9 stopped. I0425 19:02:45.978075 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 4.234107ms to process 0 records I0425 19:02:45.978155 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0425 19:02:45.978173 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 19:02:45.978180 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0425 19:02:45.978183 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0425 19:02:45.978199 1 controller.go:489] The operator is still being initialized I0425 19:02:45.978215 1 controller.go:512] The operator is healthy I0425 19:02:45.981396 1 tasks_processing.go:74] worker 2 stopped. I0425 19:02:45.981412 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 7.429226ms to process 0 records I0425 19:02:45.982132 1 tasks_processing.go:74] worker 14 stopped. I0425 19:02:45.982151 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 8.25548ms to process 0 records I0425 19:02:45.982329 1 tasks_processing.go:74] worker 8 stopped. I0425 19:02:45.982688 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=d11b0b7fe2a1d8920e21e0c2acf6ca712be69b24a58e06207afcbf6252830749 I0425 19:02:45.982749 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=009a7dbf9919eb6dba5b370eb7966f3001f01296f7b3fb9743c932d93e96d031 I0425 19:02:45.982832 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=54f899c7207f0c19e0b1bdda3df06bc0ae8d64c853c2e5318267341c3ffa7b49 I0425 19:02:45.982862 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 8.263474ms to process 3 records I0425 19:02:45.982894 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 8.493058ms to process 0 records E0425 19:02:45.982928 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0425 19:02:45.982961 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 8.051725ms to process 0 records I0425 19:02:45.983105 1 tasks_processing.go:74] worker 12 stopped. I0425 19:02:45.983133 1 tasks_processing.go:74] worker 17 stopped. I0425 19:02:45.983140 1 tasks_processing.go:74] worker 20 stopped. I0425 19:02:45.983258 1 recorder.go:75] Recording config/featuregate with fingerprint=cc0cd9355988e73c02f204ce3ba4f8a03c6841816fdcef57f897055c410b702d I0425 19:02:45.983594 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 8.832417ms to process 1 records I0425 19:02:45.998602 1 tasks_processing.go:74] worker 35 stopped. I0425 19:02:45.998615 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 24.016298ms to process 0 records I0425 19:02:45.998622 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 24.095179ms to process 0 records I0425 19:02:45.998627 1 tasks_processing.go:74] worker 32 stopped. I0425 19:02:45.998654 1 tasks_processing.go:74] worker 25 stopped. I0425 19:02:45.998670 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 23.867982ms to process 0 records E0425 19:02:45.998681 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0425 19:02:45.998690 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 24.18718ms to process 0 records I0425 19:02:45.998699 1 tasks_processing.go:74] worker 34 stopped. I0425 19:02:45.998819 1 tasks_processing.go:74] worker 53 stopped. I0425 19:02:45.998831 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 24.1879ms to process 0 records I0425 19:02:45.998985 1 tasks_processing.go:74] worker 5 stopped. I0425 19:02:45.999087 1 recorder.go:75] Recording config/ingress with fingerprint=497202655a6ab60e599e73fc152249b3e5a290b5e0ff6d5ea45bf1893e2e247e I0425 19:02:45.999106 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 24.75413ms to process 1 records E0425 19:02:45.999119 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0425 19:02:45.999126 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 23.212181ms to process 0 records I0425 19:02:45.999134 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 22.491302ms to process 0 records I0425 19:02:45.999138 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 23.113373ms to process 0 records I0425 19:02:45.999142 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 22.994571ms to process 0 records I0425 19:02:45.999145 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 23.484783ms to process 0 records I0425 19:02:45.999145 1 tasks_processing.go:74] worker 10 stopped. I0425 19:02:45.999148 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 23.797514ms to process 0 records I0425 19:02:45.999149 1 tasks_processing.go:74] worker 44 stopped. I0425 19:02:45.999152 1 tasks_processing.go:74] worker 33 stopped. I0425 19:02:45.999161 1 tasks_processing.go:74] worker 27 stopped. I0425 19:02:45.999156 1 tasks_processing.go:74] worker 60 stopped. I0425 19:02:45.999166 1 tasks_processing.go:74] worker 24 stopped. I0425 19:02:45.999158 1 tasks_processing.go:74] worker 56 stopped. I0425 19:02:45.999161 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 23.71642ms to process 0 records I0425 19:02:45.999185 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 22.970516ms to process 0 records I0425 19:02:45.999192 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 22.90357ms to process 0 records I0425 19:02:45.999195 1 tasks_processing.go:74] worker 28 stopped. I0425 19:02:45.999206 1 tasks_processing.go:74] worker 13 stopped. I0425 19:02:45.999267 1 tasks_processing.go:74] worker 23 stopped. I0425 19:02:45.999793 1 recorder.go:75] Recording config/infrastructure with fingerprint=78afee7a06bf1b02d394b3d91db9cadacbb6eed8ac12a7b554b161c1085e260e I0425 19:02:45.999806 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 22.625556ms to process 1 records I0425 19:02:45.999864 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=1c9aec80edc76ed6710f9896a09be5ca0659a42e983bdbf63b866d65713b0a1b I0425 19:02:45.999877 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=396902c609b39fe1b23ea38a8e7a5ce7219c686da99ef415d1fb0c43d6db3a02 I0425 19:02:45.999883 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 25.200944ms to process 2 records I0425 19:02:45.999904 1 tasks_processing.go:74] worker 31 stopped. I0425 19:02:45.999975 1 tasks_processing.go:74] worker 55 stopped. I0425 19:02:45.999991 1 recorder.go:75] Recording config/apiserver with fingerprint=f68fbeda6d8ee43f0b47844631974bba5ded13a0dd7b377a4c8dc7ce454e3b5a I0425 19:02:45.999998 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 23.387689ms to process 1 records E0425 19:02:46.000003 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0425 19:02:46.000009 1 gather.go:177] gatherer "clusterconfig" function "machines" took 22.947723ms to process 0 records I0425 19:02:46.000082 1 tasks_processing.go:74] worker 46 stopped. I0425 19:02:46.000152 1 recorder.go:75] Recording config/authentication with fingerprint=cce5a7e3980d014ed76d668cd04c4adb2f24aa692c311e315f4ba029705ce5c4 I0425 19:02:46.000166 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 24.076435ms to process 1 records I0425 19:02:46.000171 1 tasks_processing.go:74] worker 21 stopped. I0425 19:02:46.000248 1 tasks_processing.go:74] worker 11 stopped. I0425 19:02:46.000301 1 recorder.go:75] Recording config/network with fingerprint=441d16133b290b66a0a664b6296759b7191041d092d71fe3a13bcb2e225b84f9 I0425 19:02:46.000311 1 gather.go:177] gatherer "clusterconfig" function "networks" took 25.657431ms to process 1 records I0425 19:02:46.000395 1 tasks_processing.go:74] worker 58 stopped. I0425 19:02:46.000505 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=3ec347690a186f29ef8bf86816006d5fbae96e570c84392e73a97be66e753d98 I0425 19:02:46.000517 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 23.587506ms to process 1 records I0425 19:02:46.000529 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 23.500196ms to process 0 records I0425 19:02:46.000539 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 23.551241ms to process 0 records I0425 19:02:46.000542 1 tasks_processing.go:74] worker 51 stopped. I0425 19:02:46.000552 1 tasks_processing.go:74] worker 50 stopped. I0425 19:02:46.000619 1 tasks_processing.go:74] worker 42 stopped. I0425 19:02:46.000719 1 recorder.go:75] Recording config/oauth with fingerprint=a29339c2a5309a7d90a44603710b527733e2efc068728954b606097122a8c523 I0425 19:02:46.000729 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 23.96538ms to process 1 records I0425 19:02:46.001355 1 tasks_processing.go:74] worker 48 stopped. I0425 19:02:46.001378 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 24.715377ms to process 0 records I0425 19:02:46.001937 1 tasks_processing.go:74] worker 41 stopped. I0425 19:02:46.002014 1 recorder.go:75] Recording config/proxy with fingerprint=789ed92ab65ac0ea3f375ffa142ba53ad8ebe7b6d52f2ceacb7a488b1d99fd63 I0425 19:02:46.002031 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 27.545044ms to process 1 records I0425 19:02:46.002100 1 tasks_processing.go:74] worker 54 stopped. I0425 19:02:46.002206 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=9cd9f1c8510394ca5946d5b9c7f2df1a271c4a893a2dbf6f8b8fd1aec963ae1a I0425 19:02:46.002291 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=bc9c6ae5a6e6288d1285802aa0d63b04ebac7e90501b02d6efbbdc779f227aff I0425 19:02:46.002310 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=8855b208243f1fb6c98b8a9aab42954af9064f48e3a28e115a28b05f3a7c86fd I0425 19:02:46.002332 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=21354c2b6496c802367a2e88dd011a5e37ce858348dbe13c25462e26407695d5 I0425 19:02:46.002360 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=1d6a507f011d9f186603aecc6a24a53ad33ba17220605a43acdcdb1635b80c07 I0425 19:02:46.002390 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=5ea1f55132bbeaa836da28e58dc4763ba2d65c605e3e47cf3fd458f823bcd7b3 I0425 19:02:46.002416 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=c9c6b674684a66a1464c1857f26e48a35d594f0f70305acf7bfc1c296445e48c I0425 19:02:46.002453 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=ea08ca597bdce6dcf9d4ebd1d59fd9e4ea6e129cc2ac838ada84a02d9063cb39 I0425 19:02:46.002481 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=74a61b11fee1d13c182f5b7380d5d0a68aab7eb5266d84f6ab71d5f9b3b11ae2 I0425 19:02:46.002502 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=b7f7f73b11d33302032f47c5a126fc67b6cb55840de9b245398571336ae9a73c I0425 19:02:46.002523 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=22bb022788c6118158cece9cd54de17f5f3ac2f808b8e09462b4b52f2593e539 I0425 19:02:46.002531 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 26.305619ms to process 11 records I0425 19:02:46.002586 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=1f3018bb4f806979d8efa2d599dd8a7350b81ff6c582f76d15e559ee5602d877 I0425 19:02:46.002594 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 25.513298ms to process 1 records I0425 19:02:46.002603 1 tasks_processing.go:74] worker 49 stopped. W0425 19:02:46.004241 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 19:02:46.009362 1 tasks_processing.go:74] worker 36 stopped. I0425 19:02:46.009388 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 34.731954ms to process 0 records I0425 19:02:46.009451 1 tasks_processing.go:74] worker 26 stopped. I0425 19:02:46.009467 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 34.155647ms to process 0 records I0425 19:02:46.009920 1 tasks_processing.go:74] worker 61 stopped. I0425 19:02:46.010265 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=dfec3de127495ebb6b950c70de7efc605fc2e51b05f97993e227224aad25be32 I0425 19:02:46.010278 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 35.430229ms to process 1 records I0425 19:02:46.012386 1 tasks_processing.go:74] worker 29 stopped. I0425 19:02:46.012526 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=dca8dba5341a4f7d7b6ac2eaa8de1f893a13f270d648287285c74ebe9aed0ab5 I0425 19:02:46.012575 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=e1ffd41d979d238e4b816cf255dfeccb5cc8097a16b8b00692e3e296651f2d42 I0425 19:02:46.012615 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f753f4c9668b9365c2fdfe12ef1901f52df31a928c4c39b0526ddaf92c1ddcd5 I0425 19:02:46.012625 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 37.052493ms to process 3 records I0425 19:02:46.012732 1 tasks_processing.go:74] worker 43 stopped. I0425 19:02:46.012736 1 recorder.go:75] Recording config/image with fingerprint=3a35e2ecccac6b20a1bbabbe8717f8c2fe6f1370e8d424c860b68b7513618b9b I0425 19:02:46.012784 1 gather.go:177] gatherer "clusterconfig" function "image" took 36.08124ms to process 1 records I0425 19:02:46.012784 1 gather_logs.go:145] no pods in namespace were found I0425 19:02:46.012796 1 tasks_processing.go:74] worker 63 stopped. I0425 19:02:46.012802 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 36.481382ms to process 0 records I0425 19:02:46.013032 1 tasks_processing.go:74] worker 4 stopped. I0425 19:02:46.013058 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0425 19:02:46.013067 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 39.161359ms to process 1 records I0425 19:02:46.013307 1 tasks_processing.go:74] worker 38 stopped. I0425 19:02:46.013418 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0425 19:02:46.013434 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0425 19:02:46.013604 1 operator.go:288] started I0425 19:02:46.013608 1 recorder.go:75] Recording config/node/ip-10-0-0-229.ec2.internal with fingerprint=c9a2f11b08e0f5529e1baf8dd73bedb6791b24c510bf11f291217adc982e4edf I0425 19:02:46.013629 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0425 19:02:46.013672 1 recorder.go:75] Recording config/node/ip-10-0-1-86.ec2.internal with fingerprint=3d699bc360c80c4270f06395f508309ec3b664f8b83a497091a680384b9f12d4 I0425 19:02:46.013734 1 recorder.go:75] Recording config/node/ip-10-0-2-127.ec2.internal with fingerprint=30788d66279e90c619c63df28e66bb5a826c239a907a51b0aed9063da6a3e85f I0425 19:02:46.013743 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 38.31201ms to process 3 records I0425 19:02:46.013750 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 39.522511ms to process 0 records I0425 19:02:46.013775 1 tasks_processing.go:74] worker 18 stopped. I0425 19:02:46.014917 1 tasks_processing.go:74] worker 30 stopped. I0425 19:02:46.014936 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 39.796125ms to process 0 records I0425 19:02:46.022520 1 tasks_processing.go:74] worker 3 stopped. I0425 19:02:46.023631 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=cf06c4192e656cfded20e9fb502815b17801487e52da707587d680440cba47dc I0425 19:02:46.024211 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=d0c8d248c32f942b180f1bcdca1ffd73655e8b02058bdffeceae47df857266f9 I0425 19:02:46.024289 1 gather.go:177] gatherer "clusterconfig" function "crds" took 48.035058ms to process 2 records I0425 19:02:46.024370 1 tasks_processing.go:74] worker 16 stopped. I0425 19:02:46.025351 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=5d1e9b1846e88bb444c8e044867f382139ca3dbd0cf3b57c29a2a963e7c8088b I0425 19:02:46.025447 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=2b91e88676e1a73494a3b5524aa0418ab6e6e03f5264737206a84002642cf779 I0425 19:02:46.025457 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 46.648464ms to process 2 records I0425 19:02:46.028493 1 tasks_processing.go:74] worker 62 stopped. I0425 19:02:46.029771 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-h8wjx with fingerprint=c59abdd9e9e8258220fba0047805ea8ecc817d8d96c101f39f4d715a8ef1e3ae I0425 19:02:46.029822 1 recorder.go:75] Recording config/running_containers with fingerprint=c18f06127decfd605f6fa4978e13d8573f56d7cdaa9984c573c2f7268f8249ad I0425 19:02:46.029832 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 53.018993ms to process 2 records I0425 19:02:46.033063 1 tasks_processing.go:74] worker 40 stopped. I0425 19:02:46.033076 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 58.035948ms to process 0 records I0425 19:02:46.042279 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0425 19:02:46.042293 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0425 19:02:46.042324 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0425 19:02:46.046465 1 base_controller.go:82] Caches are synced for ConfigController I0425 19:02:46.046494 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0425 19:02:46.048735 1 controller.go:212] Source scaController *sca.Controller is not ready I0425 19:02:46.048774 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0425 19:02:46.048772 1 prometheus_rules.go:88] Prometheus rules successfully created I0425 19:02:46.048780 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 19:02:46.048787 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0425 19:02:46.048790 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0425 19:02:46.048808 1 controller.go:489] The operator is still being initialized I0425 19:02:46.048816 1 controller.go:512] The operator is healthy I0425 19:02:46.054835 1 configmapobserver.go:84] configmaps "insights-config" not found E0425 19:02:46.054972 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%279fd243e3-183d-4f59-9614-7a033d958c6a%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:53193->172.30.0.10:53: read: connection refused I0425 19:02:46.054983 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%279fd243e3-183d-4f59-9614-7a033d958c6a%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:53193->172.30.0.10:53: read: connection refused I0425 19:02:46.073403 1 tasks_processing.go:74] worker 37 stopped. E0425 19:02:46.073418 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0425 19:02:46.073424 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0425 19:02:46.073427 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0425 19:02:46.073437 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0425 19:02:46.073462 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0425 19:02:46.073467 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0425 19:02:46.073471 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0425 19:02:46.073475 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0425 19:02:46.073512 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0425 19:02:46.073520 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0425 19:02:46.073526 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 98.671975ms to process 7 records I0425 19:02:46.073941 1 tasks_processing.go:74] worker 57 stopped. E0425 19:02:46.073954 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0425 19:02:46.073959 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ptbrbtrkse8oprj72132qqb50utdbg2-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ptbrbtrkse8oprj72132qqb50utdbg2-primary-cert-bundle-secret" not found I0425 19:02:46.074014 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=bce4eb0eaa38887e28fee2dd96d806096daf9f691e0d65d7776b90324fc7e6cd I0425 19:02:46.074027 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 97.93653ms to process 1 records I0425 19:02:46.086118 1 tasks_processing.go:74] worker 7 stopped. I0425 19:02:46.086406 1 recorder.go:75] Recording config/version with fingerprint=51772d190e2f8cc5cf364c5550012cc4426ab2b65008f26f2e1134a5da7efe48 I0425 19:02:46.086421 1 recorder.go:75] Recording config/id with fingerprint=e6ec867ee5da68c9eae74b95ea32c284e0249411e2f65ca069339a4f40a7a3ad I0425 19:02:46.086427 1 gather.go:177] gatherer "clusterconfig" function "version" took 112.165058ms to process 2 records I0425 19:02:46.102106 1 tasks_processing.go:74] worker 22 stopped. I0425 19:02:46.102137 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0425 19:02:46.102150 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 126.375994ms to process 1 records I0425 19:02:46.107669 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0425 19:02:46.110877 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:60422->172.30.0.10:53: read: connection refused I0425 19:02:46.110890 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.14:60422->172.30.0.10:53: read: connection refused I0425 19:02:46.113975 1 base_controller.go:82] Caches are synced for LoggingSyncer I0425 19:02:46.113988 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0425 19:02:46.429295 1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 15 containers I0425 19:02:46.429312 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1677721 bytes I0425 19:02:46.429860 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-fgqpd pod in namespace openshift-dns (previous: false). I0425 19:02:46.655409 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-fgqpd pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-fgqpd\" is waiting to start: ContainerCreating" I0425 19:02:46.655428 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-fgqpd\" is waiting to start: ContainerCreating" I0425 19:02:46.655448 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-fgqpd pod in namespace openshift-dns (previous: false). I0425 19:02:46.837643 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-fgqpd pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-fgqpd\" is waiting to start: ContainerCreating" I0425 19:02:46.837665 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-fgqpd\" is waiting to start: ContainerCreating" I0425 19:02:46.837676 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-2cr5k pod in namespace openshift-dns (previous: false). W0425 19:02:47.004355 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 19:02:47.018623 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 19:02:47.018641 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vmsjp pod in namespace openshift-dns (previous: false). I0425 19:02:47.242407 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-resolver-vmsjp pod in namespace openshift-dns for failing operator dns-node-resolver (previous: false): "container \"dns-node-resolver\" in pod \"node-resolver-vmsjp\" is waiting to start: ContainerCreating" I0425 19:02:47.242425 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns-node-resolver\" in pod \"node-resolver-vmsjp\" is waiting to start: ContainerCreating" I0425 19:02:47.242435 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-z44kt pod in namespace openshift-dns (previous: false). I0425 19:02:47.440372 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0425 19:02:47.443597 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-resolver-z44kt pod in namespace openshift-dns for failing operator dns-node-resolver (previous: false): "container \"dns-node-resolver\" in pod \"node-resolver-z44kt\" is waiting to start: ContainerCreating" I0425 19:02:47.443612 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns-node-resolver\" in pod \"node-resolver-z44kt\" is waiting to start: ContainerCreating" I0425 19:02:47.443623 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5ff9588b4-v8p4r pod in namespace openshift-image-registry (previous: false). I0425 19:02:47.618617 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5ff9588b4-v8p4r pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5ff9588b4-v8p4r\" is waiting to start: ContainerCreating" I0425 19:02:47.618636 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5ff9588b4-v8p4r\" is waiting to start: ContainerCreating" I0425 19:02:47.618646 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5ff9588b4-xq76t pod in namespace openshift-image-registry (previous: false). I0425 19:02:47.813788 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 19:02:47.813808 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6ccbc6bd67-5z2cd pod in namespace openshift-image-registry (previous: false). I0425 19:02:47.843373 1 tasks_processing.go:74] worker 1 stopped. I0425 19:02:47.843442 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=e2563a946f54fdd95ee273839c979a364c463406aca10950c1c000782c81de12 I0425 19:02:47.843476 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=ee5f3a40e09f21869587b4d1ca383bc5c76076c268ba44f8402535c899752789 I0425 19:02:47.843515 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0425 19:02:47.843544 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=f684233c64e9843083ad277392b398842be5badf2977f0bbe51100dbfa348323 I0425 19:02:47.843562 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0425 19:02:47.843615 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=0cb62261917baf0ae940f17d3573413c6ae8494499ef87a3313780c4d881551e I0425 19:02:47.843654 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=9ae55c8c3aed2d84f749faad44d8b3c539526745b3fe858eeb31053a4e249511 I0425 19:02:47.843681 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ae0935e726b26050a02c27331441c304fc8f5579f5b0a4b16dc649bcba4c2919 I0425 19:02:47.843698 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=4893120cfec9cbd9f8c3cbaaec197639e97a03f8c004e5e8e3299faf8fa05a65 I0425 19:02:47.843729 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=1ce52438976a783d37b880ebf0582d1d8f9564d519a6a3a7d2e42c1bca029932 I0425 19:02:47.843742 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0425 19:02:47.843782 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=6593647a82ef6669ad757f15f5f7319b1a31e0a2b71c288584a9b903c8601991 I0425 19:02:47.843794 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0425 19:02:47.843815 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=62caecc197b2c6067cda01145aa54f82bf9203f417406c2750bc8b3e758b116e I0425 19:02:47.843833 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0425 19:02:47.843852 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=136fec283de24a60f79317e52c1d4ce65edb5e0583efaff331ad8ee440386dee I0425 19:02:47.843863 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0425 19:02:47.843879 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=b7b56108a588671d6c46c99c30aca6ed16f674ac5877168745d76aa3191c1878 I0425 19:02:47.844025 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=e8281120ddef5c5dce39a6c53a3839d674e13ee9f2638ea3d085e0547a7662ac I0425 19:02:47.844043 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0425 19:02:47.844060 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0425 19:02:47.844086 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0425 19:02:47.844111 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=4b7595e1cfc07d4b8df3123b42d37cda4e7dddb3193da560cea9f17b2fc40851 I0425 19:02:47.844145 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=56c716beb10de3f0f77a4353d51cf4e8aacdb829a82887b12076a929c39350bf I0425 19:02:47.844158 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0425 19:02:47.844179 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=b726ecaf8486ae28b56154813afde0f2e850d5db70e1a90186bbb9e7dab06149 I0425 19:02:47.844197 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0425 19:02:47.844216 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=29a9de1471be66f75ddf87e9ca05d5242631ec60ba62670e614a6586d4ab9d46 I0425 19:02:47.844240 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=a692462eea7e89e76d34975329a17e20c4e5914c3fd40de84440e7ad7058d74a I0425 19:02:47.844258 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=6dffc7b91a11c80af5ea51136ea2ee429ee23d2a155f68cedeef5ffeb6c4df14 I0425 19:02:47.844275 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=41716d34edfd3ebbb3cb0500d20f12a962d1941b1dea815e45f4945b4230953d I0425 19:02:47.844289 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=ba94237171b3a8d3ccaf51f648342f25a98e0a3b7694d618146f9893ba6effac I0425 19:02:47.844323 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=4c0c2b805b12aed831712ac8677239024b56474d3ea10fc95e70e75bf41d78cc I0425 19:02:47.844349 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0425 19:02:47.844360 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0425 19:02:47.844368 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.869339805s to process 35 records W0425 19:02:48.004483 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 19:02:48.013691 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 19:02:48.013708 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6ktqf pod in namespace openshift-image-registry (previous: false). I0425 19:02:48.221839 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-ca-6ktqf pod in namespace openshift-image-registry for failing operator node-ca (previous: false): "container \"node-ca\" in pod \"node-ca-6ktqf\" is waiting to start: ContainerCreating" I0425 19:02:48.221856 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"node-ca\" in pod \"node-ca-6ktqf\" is waiting to start: ContainerCreating" I0425 19:02:48.221867 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-clbjv pod in namespace openshift-image-registry (previous: false). I0425 19:02:48.419477 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-ca-clbjv pod in namespace openshift-image-registry for failing operator node-ca (previous: false): "container \"node-ca\" in pod \"node-ca-clbjv\" is waiting to start: ContainerCreating" I0425 19:02:48.419496 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"node-ca\" in pod \"node-ca-clbjv\" is waiting to start: ContainerCreating" I0425 19:02:48.419507 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-gr8p5 pod in namespace openshift-image-registry (previous: false). I0425 19:02:48.620089 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 19:02:48.620113 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-654b596757-glj5b pod in namespace openshift-ingress (previous: false). I0425 19:02:48.820962 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-654b596757-glj5b pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-654b596757-glj5b\" is waiting to start: ContainerCreating" I0425 19:02:48.820984 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-654b596757-glj5b\" is waiting to start: ContainerCreating" I0425 19:02:48.820998 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f44d8c85c-9l55d pod in namespace openshift-ingress (previous: false). W0425 19:02:49.003570 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 19:02:49.013685 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 19:02:49.013704 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f44d8c85c-9nl55 pod in namespace openshift-ingress (previous: false). I0425 19:02:49.220003 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f44d8c85c-9nl55 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f44d8c85c-9nl55\" is waiting to start: ContainerCreating" I0425 19:02:49.220021 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f44d8c85c-9nl55\" is waiting to start: ContainerCreating" I0425 19:02:49.220035 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5svcv pod in namespace openshift-ingress-canary (previous: false). I0425 19:02:49.423801 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-5svcv pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5svcv\" is waiting to start: ContainerCreating" I0425 19:02:49.423834 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5svcv\" is waiting to start: ContainerCreating" I0425 19:02:49.423852 1 tasks_processing.go:74] worker 47 stopped. I0425 19:02:49.423933 1 recorder.go:75] Recording events/openshift-dns with fingerprint=68d2cda1ed2a947b80866a07abd4b9b0ff83fc33fda7c89a3c544e340faba361 I0425 19:02:49.424043 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=6e7f5f656c35caec566737e9dd219ead050984e706986b0ff2d04479674fa1a3 I0425 19:02:49.424087 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=3b05562850a64da0a64a07048405e6f4285e5e36bbf2887751b8b45ba4138c37 I0425 19:02:49.424132 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=645c7b63c89e309632a3e62b973cee3e1a029a10d427fda3468eefb5a65ff937 I0425 19:02:49.424142 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=46cbdd0ad264491bfacb2ead91398de62a7120a7875c108ef63042d2b5db1b30 I0425 19:02:49.424149 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.448240083s to process 5 records W0425 19:02:50.003863 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0425 19:02:50.999721 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0425 19:02:50.999748 1 tasks_processing.go:74] worker 19 stopped. E0425 19:02:50.999787 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0425 19:02:50.999808 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0425 19:02:50.999823 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0425 19:02:50.999838 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.025826825s to process 1 records I0425 19:02:58.420184 1 tasks_processing.go:74] worker 39 stopped. I0425 19:02:58.420236 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0425 19:02:58.420251 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.445320382s to process 1 records I0425 19:02:59.118150 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 19:02:59.182284 1 tasks_processing.go:74] worker 52 stopped. I0425 19:02:59.182565 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=6f02bbed9776fbc53f719d04062abe458034f9ac95b2963e439b1381b6c8e3c4 I0425 19:02:59.182584 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.205791105s to process 1 records E0425 19:02:59.182643 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.208s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0425 19:02:59.183775 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0425 19:02:59.183791 1 periodic.go:209] Running workloads gatherer I0425 19:02:59.183807 1 tasks_processing.go:45] number of workers: 2 I0425 19:02:59.183816 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 19:02:59.183821 1 tasks_processing.go:71] worker 1 working on workload_info task. I0425 19:02:59.183829 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 19:02:59.183841 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0425 19:02:59.203940 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0425 19:02:59.206660 1 tasks_processing.go:74] worker 0 stopped. I0425 19:02:59.206674 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 22.805642ms to process 0 records I0425 19:02:59.212587 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (9ms) I0425 19:02:59.221366 1 gather_workloads_info.go:387] No image sha256:eff3318d5ac1d3a141221b536233305f54b3334fab56e5f8ba20ef8a9ed21429 (9ms) I0425 19:02:59.235651 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (14ms) I0425 19:02:59.245349 1 gather_workloads_info.go:387] No image sha256:80748ba08e1c264a8c105e7f607eff386a66378e024443a844993ee9292858c1 (10ms) I0425 19:02:59.254621 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0425 19:02:59.264137 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (9ms) I0425 19:02:59.273025 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (9ms) I0425 19:02:59.281854 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (9ms) I0425 19:02:59.291185 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (9ms) I0425 19:02:59.301233 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (10ms) I0425 19:02:59.312407 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (11ms) I0425 19:02:59.415623 1 gather_workloads_info.go:387] No image sha256:da4f8a01ef5d0607cf76fa7b219fafdb6020cb4cf9a0a88cfe76d292c1a561fc (103ms) I0425 19:02:59.514292 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (99ms) I0425 19:02:59.613588 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (99ms) I0425 19:02:59.713849 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0425 19:02:59.814114 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (100ms) I0425 19:02:59.913841 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (100ms) I0425 19:03:00.013287 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (99ms) I0425 19:03:00.116562 1 gather_workloads_info.go:387] No image sha256:a505dd5b62d744c2cfda2666b5e21e0a4704354a3114488bd3291456085e1e33 (103ms) I0425 19:03:00.213916 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (97ms) I0425 19:03:00.318558 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (105ms) I0425 19:03:00.419393 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (101ms) I0425 19:03:00.515117 1 gather_workloads_info.go:387] No image sha256:ef2bfb546cd8aac31b7671585f718f44b268ed43a9c8562016ab741558a7dfa1 (96ms) I0425 19:03:00.613379 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (98ms) I0425 19:03:00.714001 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (101ms) I0425 19:03:00.816035 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (102ms) I0425 19:03:00.913553 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (97ms) I0425 19:03:01.013607 1 gather_workloads_info.go:387] No image sha256:d3209a996e5ce362136e70a0bcf06d89973905de73e234b644d8ae8886d067f1 (100ms) I0425 19:03:01.113620 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0425 19:03:01.137697 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 19:03:01.214037 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0425 19:03:01.315012 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (101ms) I0425 19:03:01.342114 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 19:03:01.414357 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (99ms) I0425 19:03:01.514684 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0425 19:03:01.614476 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0425 19:03:01.725171 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (111ms) I0425 19:03:01.816226 1 gather_workloads_info.go:387] No image sha256:fab570ecdc9c3620b032bc4c5b44240f5ebac0bb9e48dfeea32bcd36eb462e5a (91ms) I0425 19:03:01.917438 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (101ms) I0425 19:03:02.015242 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (98ms) I0425 19:03:02.118260 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (103ms) I0425 19:03:02.213486 1 gather_workloads_info.go:387] No image sha256:fac526ab9335a9a8decb028a30673f4ae718deae8da114f36103b6438ba6458f (95ms) I0425 19:03:02.213523 1 tasks_processing.go:74] worker 1 stopped. E0425 19:03:02.213534 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0425 19:03:02.213890 1 recorder.go:75] Recording config/workload_info with fingerprint=75d73fd3365fbf9a0a23d180f6bee0395a08e05c0791817443fef5a31ee450a2 I0425 19:03:02.213905 1 gather.go:177] gatherer "workloads" function "workload_info" took 3.029695284s to process 1 records E0425 19:03:02.213930 1 periodic.go:247] "Unhandled Error" err="workloads failed after 3.03s with: function \"workload_info\" failed with an error" I0425 19:03:02.215036 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0425 19:03:02.215050 1 periodic.go:209] Running conditional gatherer I0425 19:03:02.224188 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0425 19:03:02.232145 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.14:46691->172.30.0.10:53: read: connection refused E0425 19:03:02.232416 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 19:03:02.232479 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0425 19:03:02.238137 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0425 19:03:02.238155 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 19:03:02.238161 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 19:03:02.238165 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 19:03:02.238167 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 19:03:02.238170 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 19:03:02.238173 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 19:03:02.238177 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 19:03:02.238179 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 19:03:02.238182 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0425 19:03:02.238198 1 tasks_processing.go:45] number of workers: 3 I0425 19:03:02.238211 1 tasks_processing.go:69] worker 2 listening for tasks. I0425 19:03:02.238215 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0425 19:03:02.238221 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 19:03:02.238235 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0425 19:03:02.238241 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0425 19:03:02.238238 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 19:03:02.238250 1 tasks_processing.go:74] worker 1 stopped. I0425 19:03:02.238302 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0425 19:03:02.238315 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 874ns to process 1 records I0425 19:03:02.238346 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0425 19:03:02.238353 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.112µs to process 1 records I0425 19:03:02.238359 1 tasks_processing.go:74] worker 0 stopped. I0425 19:03:02.238479 1 tasks_processing.go:74] worker 2 stopped. I0425 19:03:02.238492 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 231.28µs to process 0 records I0425 19:03:02.238519 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.14:46691->172.30.0.10:53: read: connection refused I0425 19:03:02.238538 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0425 19:03:02.261370 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=dd8c607e5e727ce5e4c9f8a2d18b6aa77a896ff1e3a89953554e79233932dfab I0425 19:03:02.261518 1 diskrecorder.go:70] Writing 99 records to /var/lib/insights-operator/insights-2026-04-25-190302.tar.gz I0425 19:03:02.267698 1 diskrecorder.go:51] Wrote 99 records to disk in 6ms I0425 19:03:02.267737 1 periodic.go:278] Gathering cluster info every 2h0m0s I0425 19:03:02.267772 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0425 19:03:11.023519 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 19:04:10.120476 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="411f7cc2499f6e7df96e6ffcc986a85ae6ec643a9ef519ae8307dcf8c6700af6") W0425 19:04:10.120511 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0425 19:04:10.120560 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="197962c352ac24a8cb5377bfc2fbba46bfd2eae4caea98a2e0c00a4e936fc7e2") I0425 19:04:10.120588 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0425 19:04:10.120597 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="8d36a2eca299707c94b468c96c5713cd94bdd8dc21fb9ed7609f7d09278311e4") I0425 19:04:10.120600 1 base_controller.go:181] Shutting down LoggingSyncer ... I0425 19:04:10.120617 1 base_controller.go:181] Shutting down ConfigController ... I0425 19:04:10.120643 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0425 19:04:10.120649 1 base_controller.go:113] All ConfigController workers have been terminated I0425 19:04:10.120642 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0425 19:04:10.120649 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0425 19:04:10.120662 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0425 19:04:10.120667 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0425 19:04:10.120674 1 periodic.go:170] Shutting down I0425 19:04:10.120691 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0425 19:04:10.120703 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0425 19:04:10.120702 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0425 19:04:10.120715 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting"