W0423 20:04:41.049002 1 cmd.go:257] Using insecure, self-signed certificates I0423 20:04:41.550748 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:04:41.551063 1 observer_polling.go:159] Starting file observer I0423 20:04:42.247352 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0423 20:04:42.247534 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0423 20:04:42.248097 1 secure_serving.go:57] Forcing use of http/1.1 only W0423 20:04:42.248117 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0423 20:04:42.248124 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0423 20:04:42.248128 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0423 20:04:42.248130 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0423 20:04:42.248133 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0423 20:04:42.248135 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0423 20:04:42.248180 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0423 20:04:42.251822 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0423 20:04:42.251939 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"51d5bfb7-3a0f-4050-a209-6714752f613c", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0423 20:04:42.252280 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0423 20:04:42.252297 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0423 20:04:42.252296 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0423 20:04:42.252299 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0423 20:04:42.252311 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0423 20:04:42.252312 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0423 20:04:42.252582 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3603170441/tls.crt::/tmp/serving-cert-3603170441/tls.key" I0423 20:04:42.252833 1 secure_serving.go:213] Serving securely on [::]:8443 I0423 20:04:42.252860 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0423 20:04:42.255891 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0423 20:04:42.255938 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0423 20:04:42.255977 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0423 20:04:42.261271 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0423 20:04:42.261313 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0423 20:04:42.265093 1 secretconfigobserver.go:119] support secret does not exist I0423 20:04:42.269046 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0423 20:04:42.272866 1 secretconfigobserver.go:119] support secret does not exist I0423 20:04:42.274875 1 recorder.go:161] Pruning old reports every 7h0m57s, max age is 288h0m0s I0423 20:04:42.279689 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0423 20:04:42.279709 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0423 20:04:42.279713 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0423 20:04:42.279728 1 periodic.go:209] Running clusterconfig gatherer I0423 20:04:42.279731 1 insightsreport.go:296] Starting report retriever I0423 20:04:42.279740 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0423 20:04:42.279766 1 tasks_processing.go:45] number of workers: 64 I0423 20:04:42.279793 1 tasks_processing.go:69] worker 4 listening for tasks. I0423 20:04:42.279806 1 tasks_processing.go:69] worker 0 listening for tasks. I0423 20:04:42.279811 1 tasks_processing.go:69] worker 18 listening for tasks. I0423 20:04:42.279817 1 tasks_processing.go:69] worker 2 listening for tasks. I0423 20:04:42.279820 1 tasks_processing.go:71] worker 18 working on operators_pods_and_events task. I0423 20:04:42.279828 1 tasks_processing.go:69] worker 11 listening for tasks. I0423 20:04:42.279831 1 tasks_processing.go:69] worker 1 listening for tasks. I0423 20:04:42.279815 1 tasks_processing.go:71] worker 0 working on openstack_controlplanes task. I0423 20:04:42.279838 1 tasks_processing.go:69] worker 19 listening for tasks. I0423 20:04:42.279842 1 tasks_processing.go:69] worker 5 listening for tasks. I0423 20:04:42.279838 1 tasks_processing.go:69] worker 42 listening for tasks. I0423 20:04:42.279846 1 tasks_processing.go:69] worker 20 listening for tasks. I0423 20:04:42.279849 1 tasks_processing.go:69] worker 43 listening for tasks. I0423 20:04:42.279852 1 tasks_processing.go:69] worker 21 listening for tasks. I0423 20:04:42.279856 1 tasks_processing.go:69] worker 44 listening for tasks. I0423 20:04:42.279858 1 tasks_processing.go:69] worker 9 listening for tasks. I0423 20:04:42.279854 1 tasks_processing.go:69] worker 14 listening for tasks. I0423 20:04:42.279865 1 tasks_processing.go:69] worker 45 listening for tasks. I0423 20:04:42.279867 1 tasks_processing.go:69] worker 10 listening for tasks. I0423 20:04:42.279863 1 tasks_processing.go:69] worker 22 listening for tasks. I0423 20:04:42.279869 1 tasks_processing.go:69] worker 33 listening for tasks. I0423 20:04:42.279864 1 tasks_processing.go:69] worker 8 listening for tasks. I0423 20:04:42.279874 1 tasks_processing.go:69] worker 12 listening for tasks. I0423 20:04:42.279875 1 tasks_processing.go:69] worker 27 listening for tasks. I0423 20:04:42.279882 1 tasks_processing.go:69] worker 13 listening for tasks. I0423 20:04:42.279877 1 tasks_processing.go:69] worker 6 listening for tasks. I0423 20:04:42.279882 1 tasks_processing.go:69] worker 32 listening for tasks. I0423 20:04:42.279885 1 tasks_processing.go:69] worker 7 listening for tasks. I0423 20:04:42.279893 1 tasks_processing.go:69] worker 34 listening for tasks. I0423 20:04:42.279911 1 tasks_processing.go:69] worker 25 listening for tasks. I0423 20:04:42.279914 1 tasks_processing.go:69] worker 48 listening for tasks. I0423 20:04:42.279915 1 tasks_processing.go:69] worker 28 listening for tasks. I0423 20:04:42.279917 1 tasks_processing.go:69] worker 31 listening for tasks. I0423 20:04:42.279915 1 tasks_processing.go:69] worker 16 listening for tasks. I0423 20:04:42.279930 1 tasks_processing.go:69] worker 26 listening for tasks. I0423 20:04:42.279881 1 tasks_processing.go:69] worker 23 listening for tasks. I0423 20:04:42.279928 1 tasks_processing.go:69] worker 29 listening for tasks. I0423 20:04:42.279940 1 tasks_processing.go:69] worker 40 listening for tasks. I0423 20:04:42.279939 1 tasks_processing.go:69] worker 15 listening for tasks. I0423 20:04:42.279944 1 tasks_processing.go:69] worker 50 listening for tasks. I0423 20:04:42.279945 1 tasks_processing.go:71] worker 23 working on machine_configs task. I0423 20:04:42.279949 1 tasks_processing.go:69] worker 55 listening for tasks. I0423 20:04:42.279952 1 tasks_processing.go:71] worker 50 working on metrics task. I0423 20:04:42.279950 1 tasks_processing.go:69] worker 41 listening for tasks. I0423 20:04:42.279951 1 tasks_processing.go:69] worker 51 listening for tasks. I0423 20:04:42.279953 1 tasks_processing.go:69] worker 60 listening for tasks. I0423 20:04:42.279962 1 tasks_processing.go:71] worker 22 working on openstack_dataplanenodesets task. I0423 20:04:42.279958 1 tasks_processing.go:71] worker 4 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0423 20:04:42.279966 1 tasks_processing.go:71] worker 6 working on olm_operators task. I0423 20:04:42.279968 1 tasks_processing.go:71] worker 60 working on silenced_alerts task. I0423 20:04:42.279967 1 tasks_processing.go:71] worker 13 working on schedulers task. I0423 20:04:42.279971 1 tasks_processing.go:71] worker 41 working on oauths task. I0423 20:04:42.279974 1 tasks_processing.go:71] worker 32 working on version task. I0423 20:04:42.279982 1 tasks_processing.go:71] worker 12 working on operators task. I0423 20:04:42.279971 1 tasks_processing.go:69] worker 52 listening for tasks. I0423 20:04:42.279987 1 tasks_processing.go:71] worker 15 working on tsdb_status task. I0423 20:04:42.279995 1 tasks_processing.go:71] worker 20 working on clusterroles task. W0423 20:04:42.279996 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:04:42.279993 1 tasks_processing.go:71] worker 40 working on sap_config task. W0423 20:04:42.280009 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0423 20:04:42.279978 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:04:42.280014 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 33.174µs to process 0 records I0423 20:04:42.279940 1 tasks_processing.go:69] worker 54 listening for tasks. I0423 20:04:42.279878 1 tasks_processing.go:69] worker 46 listening for tasks. I0423 20:04:42.280014 1 tasks_processing.go:71] worker 1 working on machine_autoscalers task. I0423 20:04:42.280025 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 19.716µs to process 0 records I0423 20:04:42.280029 1 tasks_processing.go:71] worker 9 working on ceph_cluster task. I0423 20:04:42.280032 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 61.012µs to process 0 records I0423 20:04:42.279967 1 tasks_processing.go:71] worker 27 working on container_runtime_configs task. I0423 20:04:42.280047 1 tasks_processing.go:71] worker 15 working on config_maps task. I0423 20:04:42.279919 1 tasks_processing.go:69] worker 35 listening for tasks. I0423 20:04:42.279892 1 tasks_processing.go:69] worker 17 listening for tasks. I0423 20:04:42.279924 1 tasks_processing.go:69] worker 49 listening for tasks. I0423 20:04:42.279925 1 tasks_processing.go:69] worker 36 listening for tasks. I0423 20:04:42.279931 1 tasks_processing.go:69] worker 57 listening for tasks. I0423 20:04:42.279931 1 tasks_processing.go:69] worker 53 listening for tasks. I0423 20:04:42.279931 1 tasks_processing.go:69] worker 58 listening for tasks. I0423 20:04:42.279932 1 tasks_processing.go:69] worker 37 listening for tasks. I0423 20:04:42.279938 1 tasks_processing.go:69] worker 39 listening for tasks. I0423 20:04:42.280119 1 tasks_processing.go:71] worker 43 working on openstack_dataplanedeployments task. I0423 20:04:42.280128 1 tasks_processing.go:71] worker 5 working on cost_management_metrics_configs task. I0423 20:04:42.280147 1 tasks_processing.go:71] worker 60 working on image_pruners task. I0423 20:04:42.280152 1 tasks_processing.go:71] worker 45 working on openshift_machine_api_events task. I0423 20:04:42.280170 1 tasks_processing.go:71] worker 54 working on dvo_metrics task. I0423 20:04:42.280184 1 tasks_processing.go:71] worker 52 working on container_images task. I0423 20:04:42.279912 1 tasks_processing.go:69] worker 30 listening for tasks. I0423 20:04:42.279945 1 tasks_processing.go:71] worker 29 working on jaegers task. I0423 20:04:42.280287 1 tasks_processing.go:71] worker 34 working on machine_healthchecks task. I0423 20:04:42.281010 1 tasks_processing.go:71] worker 19 working on service_accounts task. I0423 20:04:42.281046 1 tasks_processing.go:71] worker 2 working on nodes task. I0423 20:04:42.281058 1 tasks_processing.go:71] worker 44 working on nodenetworkconfigurationpolicies task. I0423 20:04:42.279814 1 tasks_processing.go:69] worker 3 listening for tasks. I0423 20:04:42.279944 1 tasks_processing.go:69] worker 38 listening for tasks. I0423 20:04:42.279955 1 tasks_processing.go:69] worker 61 listening for tasks. I0423 20:04:42.279955 1 tasks_processing.go:69] worker 56 listening for tasks. I0423 20:04:42.279956 1 tasks_processing.go:69] worker 63 listening for tasks. I0423 20:04:42.279966 1 tasks_processing.go:71] worker 51 working on certificate_signing_requests task. I0423 20:04:42.281121 1 tasks_processing.go:71] worker 42 working on openshift_logging task. I0423 20:04:42.281147 1 tasks_processing.go:71] worker 48 working on ingress task. I0423 20:04:42.281156 1 tasks_processing.go:71] worker 46 working on machine_config_pools task. I0423 20:04:42.281191 1 tasks_processing.go:71] worker 14 working on storage_classes task. I0423 20:04:42.279958 1 tasks_processing.go:71] worker 55 working on aggregated_monitoring_cr_names task. I0423 20:04:42.279945 1 tasks_processing.go:69] worker 62 listening for tasks. I0423 20:04:42.279973 1 tasks_processing.go:71] worker 33 working on authentication task. I0423 20:04:42.279978 1 tasks_processing.go:71] worker 8 working on node_logs task. I0423 20:04:42.279888 1 tasks_processing.go:69] worker 47 listening for tasks. I0423 20:04:42.280043 1 tasks_processing.go:71] worker 50 working on openstack_version task. I0423 20:04:42.280114 1 tasks_processing.go:71] worker 21 working on storage_cluster task. I0423 20:04:42.281208 1 tasks_processing.go:71] worker 31 working on support_secret task. I0423 20:04:42.281313 1 tasks_processing.go:71] worker 62 working on machine_sets task. I0423 20:04:42.279966 1 tasks_processing.go:71] worker 7 working on overlapping_namespace_uids task. I0423 20:04:42.281213 1 tasks_processing.go:71] worker 16 working on nodenetworkstates task. I0423 20:04:42.281217 1 tasks_processing.go:71] worker 28 working on infrastructures task. I0423 20:04:42.281213 1 tasks_processing.go:71] worker 25 working on active_alerts task. I0423 20:04:42.281543 1 tasks_processing.go:71] worker 47 working on validating_webhook_configurations task. W0423 20:04:42.282063 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:04:42.282112 1 tasks_processing.go:74] worker 25 stopped. I0423 20:04:42.282139 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 567.706µs to process 0 records I0423 20:04:42.281219 1 tasks_processing.go:71] worker 10 working on image_registries task. I0423 20:04:42.281222 1 tasks_processing.go:71] worker 11 working on image task. I0423 20:04:42.279948 1 tasks_processing.go:69] worker 59 listening for tasks. I0423 20:04:42.279888 1 tasks_processing.go:69] worker 24 listening for tasks. I0423 20:04:42.281227 1 tasks_processing.go:71] worker 49 working on networks task. I0423 20:04:42.282387 1 tasks_processing.go:74] worker 59 stopped. I0423 20:04:42.282450 1 tasks_processing.go:74] worker 24 stopped. I0423 20:04:42.281229 1 tasks_processing.go:71] worker 26 working on cluster_apiserver task. I0423 20:04:42.281230 1 tasks_processing.go:71] worker 63 working on sap_pods task. I0423 20:04:42.281234 1 tasks_processing.go:71] worker 36 working on proxies task. I0423 20:04:42.281230 1 tasks_processing.go:71] worker 35 working on crds task. I0423 20:04:42.281234 1 tasks_processing.go:71] worker 39 working on mutating_webhook_configurations task. I0423 20:04:42.281238 1 tasks_processing.go:71] worker 30 working on ingress_certificates task. I0423 20:04:42.281238 1 tasks_processing.go:71] worker 57 working on monitoring_persistent_volumes task. I0423 20:04:42.281240 1 tasks_processing.go:71] worker 58 working on pod_network_connectivity_checks task. I0423 20:04:42.281241 1 tasks_processing.go:71] worker 3 working on machines task. I0423 20:04:42.281243 1 tasks_processing.go:71] worker 37 working on lokistack task. I0423 20:04:42.281245 1 tasks_processing.go:71] worker 38 working on pdbs task. I0423 20:04:42.281245 1 tasks_processing.go:71] worker 53 working on feature_gates task. I0423 20:04:42.281246 1 tasks_processing.go:71] worker 61 working on install_plans task. I0423 20:04:42.281248 1 tasks_processing.go:71] worker 56 working on sap_datahubs task. I0423 20:04:42.281235 1 tasks_processing.go:71] worker 17 working on qemu_kubevirt_launcher_logs task. I0423 20:04:42.284766 1 tasks_processing.go:74] worker 22 stopped. I0423 20:04:42.284776 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 4.795549ms to process 0 records I0423 20:04:42.284787 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 4.928494ms to process 0 records I0423 20:04:42.284795 1 tasks_processing.go:74] worker 0 stopped. I0423 20:04:42.285135 1 tasks_processing.go:74] worker 27 stopped. I0423 20:04:42.285151 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 5.083523ms to process 0 records I0423 20:04:42.285300 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0423 20:04:42.285315 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0423 20:04:42.285320 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0423 20:04:42.285323 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0423 20:04:42.285337 1 controller.go:489] The operator is still being initialized I0423 20:04:42.285344 1 controller.go:512] The operator is healthy I0423 20:04:42.285979 1 tasks_processing.go:74] worker 1 stopped. I0423 20:04:42.285991 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 5.944704ms to process 0 records I0423 20:04:42.288046 1 tasks_processing.go:74] worker 13 stopped. I0423 20:04:42.288126 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=a5e11df1d231de54ae2f6f561765d97db46abf679bfa6cb2f41ea630df3e5800 I0423 20:04:42.288137 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 8.062679ms to process 1 records I0423 20:04:42.291026 1 tasks_processing.go:74] worker 9 stopped. I0423 20:04:42.291043 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 10.98552ms to process 0 records I0423 20:04:42.291270 1 tasks_processing.go:74] worker 41 stopped. I0423 20:04:42.291472 1 recorder.go:75] Recording config/oauth with fingerprint=5637c7922e88dccd3dd14066c7443cb5159873fb942ad8b27eac65d05adc0d07 I0423 20:04:42.291485 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 11.282295ms to process 1 records I0423 20:04:42.292657 1 tasks_processing.go:74] worker 5 stopped. I0423 20:04:42.292667 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 12.517901ms to process 0 records I0423 20:04:42.293082 1 tasks_processing.go:74] worker 34 stopped. E0423 20:04:42.293093 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0423 20:04:42.293099 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 12.780574ms to process 0 records I0423 20:04:42.293698 1 tasks_processing.go:74] worker 43 stopped. I0423 20:04:42.293709 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 13.567371ms to process 0 records I0423 20:04:42.294776 1 tasks_processing.go:74] worker 50 stopped. I0423 20:04:42.294785 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 13.363368ms to process 0 records I0423 20:04:42.294794 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 14.760307ms to process 0 records I0423 20:04:42.294799 1 tasks_processing.go:74] worker 40 stopped. I0423 20:04:42.295030 1 tasks_processing.go:74] worker 21 stopped. I0423 20:04:42.295046 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 13.606799ms to process 0 records I0423 20:04:42.295207 1 tasks_processing.go:74] worker 29 stopped. I0423 20:04:42.295217 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 14.953167ms to process 0 records I0423 20:04:42.295761 1 tasks_processing.go:74] worker 42 stopped. I0423 20:04:42.295779 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 14.626015ms to process 0 records I0423 20:04:42.296037 1 tasks_processing.go:74] worker 62 stopped. I0423 20:04:42.296047 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 14.716316ms to process 0 records I0423 20:04:42.296816 1 tasks_processing.go:74] worker 60 stopped. I0423 20:04:42.297019 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=474427fed44b0c37a75cafa13db758c9e39ecfe75345b70c2a1067f61470541f I0423 20:04:42.297031 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 16.656357ms to process 1 records I0423 20:04:42.305368 1 tasks_processing.go:74] worker 16 stopped. I0423 20:04:42.305388 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 23.930021ms to process 0 records I0423 20:04:42.305439 1 tasks_processing.go:74] worker 45 stopped. I0423 20:04:42.305453 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 25.277083ms to process 0 records I0423 20:04:42.305514 1 tasks_processing.go:74] worker 63 stopped. I0423 20:04:42.305525 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 23.015711ms to process 0 records I0423 20:04:42.305611 1 tasks_processing.go:74] worker 48 stopped. I0423 20:04:42.305752 1 recorder.go:75] Recording config/ingress with fingerprint=3e881bb54117479fb8899997354bb084a2d7a9d1a25be2ab08de963d537c5ef3 I0423 20:04:42.305768 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 24.446439ms to process 1 records E0423 20:04:42.305778 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0423 20:04:42.305784 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 22.619945ms to process 0 records I0423 20:04:42.305790 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 22.641751ms to process 0 records I0423 20:04:42.305792 1 tasks_processing.go:74] worker 58 stopped. E0423 20:04:42.305797 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0423 20:04:42.305799 1 tasks_processing.go:74] worker 37 stopped. I0423 20:04:42.305806 1 gather.go:177] gatherer "clusterconfig" function "machines" took 22.676186ms to process 0 records I0423 20:04:42.305815 1 tasks_processing.go:74] worker 3 stopped. I0423 20:04:42.305876 1 tasks_processing.go:74] worker 11 stopped. I0423 20:04:42.306006 1 recorder.go:75] Recording config/image with fingerprint=4202c73a60b1ab55e90510c62b55a270803d9f50b6be1c60da4729a75d79a182 I0423 20:04:42.306023 1 gather.go:177] gatherer "clusterconfig" function "image" took 23.586781ms to process 1 records I0423 20:04:42.306118 1 tasks_processing.go:74] worker 28 stopped. I0423 20:04:42.306572 1 recorder.go:75] Recording config/infrastructure with fingerprint=f6bbd1401e3da4b45fde797ba47cf76bca2beadd7ff1a1477f84d72959c95684 I0423 20:04:42.306590 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 24.492705ms to process 1 records I0423 20:04:42.306664 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=102a954d53f55596b8de1715f35001ff92e17c19a774e965ed0471d9b92f6012 I0423 20:04:42.306679 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=e691de08d43990875ab80762aeb89263237c134ac3617bb31862b9394b716629 I0423 20:04:42.306683 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 24.751264ms to process 2 records I0423 20:04:42.306684 1 tasks_processing.go:74] worker 14 stopped. E0423 20:04:42.306691 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0423 20:04:42.306697 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 24.80838ms to process 0 records I0423 20:04:42.306697 1 tasks_processing.go:74] worker 31 stopped. I0423 20:04:42.306702 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 25.071589ms to process 0 records I0423 20:04:42.306707 1 tasks_processing.go:74] worker 44 stopped. I0423 20:04:42.306777 1 tasks_processing.go:74] worker 33 stopped. I0423 20:04:42.306890 1 recorder.go:75] Recording config/authentication with fingerprint=4f27f3c1c0c31efbcea730cf89425376f35583279f8989560a9d4a2740020df8 I0423 20:04:42.306928 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 25.122225ms to process 1 records I0423 20:04:42.309136 1 tasks_processing.go:74] worker 2 stopped. I0423 20:04:42.309420 1 recorder.go:75] Recording config/node/ip-10-0-0-170.ec2.internal with fingerprint=4094c045ff94c762d03fe2e3461e3b96dc21388969d0515ee938f5208840a6bf I0423 20:04:42.309485 1 recorder.go:75] Recording config/node/ip-10-0-1-103.ec2.internal with fingerprint=92bd263dff3d5cf793c0573abf829e11c2c5ed73b5db02138eb811d1cf660c39 I0423 20:04:42.309536 1 recorder.go:75] Recording config/node/ip-10-0-2-54.ec2.internal with fingerprint=e3726509c8a7600d85a532422a9dfd27aeb86a5e6f0de002edee16d499cbeb4c I0423 20:04:42.309546 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 28.075403ms to process 3 records I0423 20:04:42.310637 1 tasks_processing.go:74] worker 51 stopped. I0423 20:04:42.310652 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 29.536575ms to process 0 records W0423 20:04:42.311328 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:04:42.314993 1 tasks_processing.go:74] worker 36 stopped. I0423 20:04:42.315059 1 recorder.go:75] Recording config/proxy with fingerprint=387320d9ab14a708dd95c1f9fbcfaaee440a28c76f9431533d1a91531dde9058 I0423 20:04:42.315076 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 32.244881ms to process 1 records I0423 20:04:42.315548 1 tasks_processing.go:74] worker 8 stopped. I0423 20:04:42.315559 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 34.164868ms to process 0 records I0423 20:04:42.315603 1 tasks_processing.go:74] worker 56 stopped. I0423 20:04:42.315616 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 32.488548ms to process 0 records I0423 20:04:42.315784 1 tasks_processing.go:74] worker 26 stopped. I0423 20:04:42.315944 1 recorder.go:75] Recording config/apiserver with fingerprint=35f3292af13c803129e6f7b527190182ee0fa22b4efb4111b5a78202b3c6e49a I0423 20:04:42.315956 1 gather_logs.go:145] no pods in namespace were found I0423 20:04:42.315961 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 33.321472ms to process 1 records I0423 20:04:42.315967 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 32.798971ms to process 0 records I0423 20:04:42.315971 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 32.844669ms to process 0 records I0423 20:04:42.315977 1 tasks_processing.go:74] worker 17 stopped. I0423 20:04:42.315981 1 tasks_processing.go:74] worker 57 stopped. I0423 20:04:42.316115 1 tasks_processing.go:74] worker 49 stopped. I0423 20:04:42.316258 1 recorder.go:75] Recording config/network with fingerprint=96cf80940aed675e24827bbfa3e6e30acd24d75a990c85fe2c85035333fc5495 I0423 20:04:42.316276 1 gather.go:177] gatherer "clusterconfig" function "networks" took 33.716377ms to process 1 records I0423 20:04:42.316532 1 tasks_processing.go:74] worker 10 stopped. I0423 20:04:42.316852 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=9238668e56ca228919f09df6b60becf7a31a3d7caa760cf27cc7fbb12158cce6 I0423 20:04:42.316866 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 34.337761ms to process 1 records I0423 20:04:42.316927 1 tasks_processing.go:74] worker 38 stopped. I0423 20:04:42.316956 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=09ddc2915d1aa794d0a9564ef69eccaf7c42b149920c010bb07da5c8c4042c4f I0423 20:04:42.316971 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=d92cdbd15c518d05177750b01788809b87330bb05a9fe4b0a0caf8ffa4d657a2 I0423 20:04:42.316986 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=4ff3af2a0d00484294294f0a7e5b51d7b9de0b6c2db05dfcaa74a32157b3d955 I0423 20:04:42.316997 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 33.517443ms to process 3 records I0423 20:04:42.317034 1 tasks_processing.go:74] worker 39 stopped. I0423 20:04:42.317191 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=dd6315d74bbd59fc6d6d2e64f43b4020e9995185e13f5d33c07dfd9405e1a168 I0423 20:04:42.317222 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=42982c7fa3395ba3b7026d1bbd854e588de40b03a2728221b5994074740be343 I0423 20:04:42.317246 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=7e69f9312484299f40a87bb42e27a2db2a0f672d6d2860822acf98205fb96a43 I0423 20:04:42.317255 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.969058ms to process 3 records I0423 20:04:42.317339 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=432aece5131031504e105444346c2081cc0dae77a42bed4b382716101e391f3b I0423 20:04:42.317338 1 tasks_processing.go:74] worker 47 stopped. I0423 20:04:42.317412 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=2cd9add0f6abe4a5dcc36a10c0e56301b294273e046d6870ede1cec518e39900 I0423 20:04:42.317429 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=143496616e1dc3e4d3b52d43493ca18a2b66eb0c587b4bb2e8b4a04b7ef558da I0423 20:04:42.317449 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=8e8fd04eb82c022b07c7020025374dc9b3476e31ea78d2b84e14c64f7d174b98 I0423 20:04:42.317471 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=e49331e45ef4f86cad7400ee8c4db6e3d903edda3687fe06f62f552ad4499862 I0423 20:04:42.317495 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=530c6cc31d458d6863ce221bc92c1b9150379a83d5294d0bd45ddf89466efdc5 I0423 20:04:42.317517 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=ece005ac2f1f1d0e04d817cca511917bf823308d38a1934d70aa9041505fb4c9 I0423 20:04:42.317554 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=2f2e7566d1c48316a79f38d9c688e413f43c573d0811bbbd9543c014b9e8a9e4 I0423 20:04:42.317576 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=dea3a9055f912c3c3be7128dffa17da736db1fc838c28f67387b9ea852a524bf I0423 20:04:42.317598 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=aed8ac91351e1e119f1bedc0e8fbfcd5cd7107c7d91d1d3f82951efbc6cc05d7 I0423 20:04:42.317620 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=14b23659bfad4e6613a46af968ba913f048432e285f3af5f59bab29f405aee3e I0423 20:04:42.317627 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 35.252395ms to process 11 records I0423 20:04:42.317702 1 recorder.go:75] Recording config/featuregate with fingerprint=83c29b10889588bffa726e0d96c9d0f143f902f2f7803beffa6f5e03ca321106 I0423 20:04:42.317702 1 tasks_processing.go:74] worker 53 stopped. I0423 20:04:42.317709 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 34.132339ms to process 1 records I0423 20:04:42.317823 1 tasks_processing.go:74] worker 20 stopped. I0423 20:04:42.317831 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=1206d0e90b1b7651f91be70c7890c7c1a104466bedc309f24640e480a55ab116 I0423 20:04:42.317930 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=29e0baf45442c274060011e8ae5f762c13bd20031d407b7ff4146225a5eb02c5 I0423 20:04:42.317939 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 37.310954ms to process 2 records I0423 20:04:42.321200 1 tasks_processing.go:74] worker 6 stopped. I0423 20:04:42.321252 1 recorder.go:75] Recording config/olm_operators with fingerprint=9929b503b9a9b3080f4a62abda5740ebf3a03632eb41ef1ff071877c795e8e11 I0423 20:04:42.321264 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 41.221015ms to process 1 records I0423 20:04:42.321461 1 tasks_processing.go:74] worker 55 stopped. I0423 20:04:42.321481 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 40.145424ms to process 0 records I0423 20:04:42.321665 1 tasks_processing.go:74] worker 7 stopped. I0423 20:04:42.321698 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0423 20:04:42.321714 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 40.320555ms to process 1 records I0423 20:04:42.325116 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0423 20:04:42.325119 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0423 20:04:42.325304 1 operator.go:288] started I0423 20:04:42.325331 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0423 20:04:42.331661 1 tasks_processing.go:74] worker 46 stopped. I0423 20:04:42.331676 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 50.494434ms to process 0 records I0423 20:04:42.333674 1 tasks_processing.go:74] worker 35 stopped. I0423 20:04:42.335075 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=ccb397b0e8665e795e22c4307332a0974dbcc995be469b6c9145f9741b42ee39 I0423 20:04:42.335498 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=7d0490c6a8f705ee7536ec1837de832ef538757a97d82565b4ec99c055704b8f I0423 20:04:42.335518 1 gather.go:177] gatherer "clusterconfig" function "crds" took 50.690416ms to process 2 records I0423 20:04:42.335652 1 tasks_processing.go:74] worker 52 stopped. I0423 20:04:42.335744 1 recorder.go:75] Recording config/running_containers with fingerprint=ab528c1b190223f19b1ba7c9a5a43998ec04041f25107058662c8727590cd960 I0423 20:04:42.335756 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 55.448046ms to process 1 records I0423 20:04:42.335769 1 controller.go:212] Source scaController *sca.Controller is not ready I0423 20:04:42.335790 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0423 20:04:42.335795 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0423 20:04:42.335798 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0423 20:04:42.335803 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0423 20:04:42.335824 1 controller.go:489] The operator is still being initialized I0423 20:04:42.335835 1 controller.go:512] The operator is healthy I0423 20:04:42.339595 1 prometheus_rules.go:88] Prometheus rules successfully created I0423 20:04:42.339719 1 tasks_processing.go:74] worker 15 stopped. E0423 20:04:42.339732 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0423 20:04:42.339737 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0423 20:04:42.339742 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0423 20:04:42.339754 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0423 20:04:42.339780 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0423 20:04:42.339787 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0423 20:04:42.339792 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0423 20:04:42.339795 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0423 20:04:42.339839 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0423 20:04:42.339847 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0423 20:04:42.339853 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 59.656383ms to process 7 records I0423 20:04:42.341059 1 tasks_processing.go:74] worker 4 stopped. I0423 20:04:42.341071 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 61.082837ms to process 0 records E0423 20:04:42.341740 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2789091e3a-f627-40d1-ba41-e4f9bc51a749%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:41153->172.30.0.10:53: read: connection refused I0423 20:04:42.341752 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2789091e3a-f627-40d1-ba41-e4f9bc51a749%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:41153->172.30.0.10:53: read: connection refused I0423 20:04:42.353258 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0423 20:04:42.353271 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0423 20:04:42.353344 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0423 20:04:42.356542 1 base_controller.go:82] Caches are synced for ConfigController I0423 20:04:42.356554 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0423 20:04:42.360455 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:04:42.391161 1 tasks_processing.go:74] worker 32 stopped. I0423 20:04:42.391371 1 recorder.go:75] Recording config/version with fingerprint=745cd9e52c6de7f17f1abf2367db83204b6dd89d07c39f0e15641e0d5a29c235 I0423 20:04:42.391384 1 recorder.go:75] Recording config/id with fingerprint=b3d53b8fad7853979b2eef551c59bb067ad446dfa994f82001e454b6eebbcb8b I0423 20:04:42.391390 1 gather.go:177] gatherer "clusterconfig" function "version" took 111.171514ms to process 2 records I0423 20:04:42.405174 1 tasks_processing.go:74] worker 23 stopped. I0423 20:04:42.405199 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0423 20:04:42.405207 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 125.212656ms to process 1 records I0423 20:04:42.410744 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0423 20:04:42.413881 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:51373->172.30.0.10:53: read: connection refused I0423 20:04:42.413910 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:51373->172.30.0.10:53: read: connection refused I0423 20:04:42.425501 1 base_controller.go:82] Caches are synced for LoggingSyncer I0423 20:04:42.425511 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0423 20:04:42.433431 1 tasks_processing.go:74] worker 30 stopped. E0423 20:04:42.433449 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0423 20:04:42.433458 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ps2fsqa9qi4es7qua5qi26vvonhq6c4-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ps2fsqa9qi4es7qua5qi26vvonhq6c4-primary-cert-bundle-secret" not found I0423 20:04:42.433511 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=9b2dca7d5aa09148bd49373041366693298e5ac646a3c2f14d8a43a42905d16f I0423 20:04:42.433523 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 150.355175ms to process 1 records W0423 20:04:43.309814 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:04:43.503574 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0423 20:04:43.503588 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0423 20:04:43.504293 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-fv4g8 pod in namespace openshift-dns (previous: false). I0423 20:04:43.730233 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0423 20:04:43.738199 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-fv4g8 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-fv4g8\" is waiting to start: ContainerCreating" I0423 20:04:43.738213 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-fv4g8\" is waiting to start: ContainerCreating" I0423 20:04:43.738221 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-fv4g8 pod in namespace openshift-dns (previous: false). I0423 20:04:43.909035 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-fv4g8 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-fv4g8\" is waiting to start: ContainerCreating" I0423 20:04:43.909049 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-fv4g8\" is waiting to start: ContainerCreating" I0423 20:04:43.909078 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-lp77x pod in namespace openshift-dns (previous: false). I0423 20:04:44.128478 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lp77x pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-lp77x\" is waiting to start: ContainerCreating" I0423 20:04:44.128493 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-lp77x\" is waiting to start: ContainerCreating" I0423 20:04:44.128501 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-lp77x pod in namespace openshift-dns (previous: false). I0423 20:04:44.129611 1 tasks_processing.go:74] worker 12 stopped. I0423 20:04:44.129652 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=ec352dc488b4fcc046a1928189026cbf23624cceb3a6597d8ed0db8be9da0fd7 I0423 20:04:44.129684 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=d0a67c8fa9a5b843b8c02c701e10821a420c7da3c83b0e6b72c3e7c2a53f6177 I0423 20:04:44.129713 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0423 20:04:44.129739 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=adcf6c5d68c9bbbd00ef729480aaab947e08860466ad0822785c221fc439bae0 I0423 20:04:44.129755 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0423 20:04:44.129792 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=166e15db37cfd86a11e0d1bb8169bff4df2d1adb44f572c881b04e492dc5ef90 I0423 20:04:44.129822 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=dd84689b676b4c58a5d667eb7b28209268535bfe04b692db19397ef725929fc9 I0423 20:04:44.129846 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=c3727683ca2d1280d24ecea409ec5816237b06fd31b40cb4538fe5f145155abb I0423 20:04:44.129859 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=4865d59e92be74b0492258867d76f4247a2cdceb1f85b382e8f995edbda8bc4a I0423 20:04:44.129887 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=7c5bc09912b9c9599b6c4fd11ce65728435e0536f892bf4c05eedb5c4321933d I0423 20:04:44.129916 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0423 20:04:44.129932 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=00f342e8871c3ad7b4d813024d66ce4abcbfdfc04614969cfca99e407f5d9404 I0423 20:04:44.129941 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0423 20:04:44.129957 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=1e9e128d8ec4eae653699e5ae4a02279acc0b424c83fb0d0eb39fd8e2593d238 I0423 20:04:44.129967 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0423 20:04:44.129986 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=14657b3f79a92f8af4241cc54918a4738139e37539196c465a43bfda217d5c4e I0423 20:04:44.129995 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0423 20:04:44.130010 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=901f4a38c4981faa90e2912a467b88100ffeed3845cdd7d3c779538fbf2d61d1 I0423 20:04:44.130151 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=78985403b06b373196b2b79b3f6f93cfc6619acfe9fcbd7bd4029d47f0553017 I0423 20:04:44.130161 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0423 20:04:44.130175 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0423 20:04:44.130199 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0423 20:04:44.130221 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=86e26eabe5bf36baef9baf8778171f19a5bb763d72a3e50084f98a68b02a2548 I0423 20:04:44.130244 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=f16f49535d4b764220fec2a27d67b5d47eb6017d6f4f0de929b7e5e108ec3a65 I0423 20:04:44.130253 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0423 20:04:44.130268 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=035daa485b5ddc83503f4dc6828a0f069c30c870361afb8bb1bd5438e9ab0630 I0423 20:04:44.130278 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0423 20:04:44.130290 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=ae7d1e9bd987d20848f3b7ce70bf51aac5377bba58ffcd5021cf50a76d9c0d70 I0423 20:04:44.130305 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=57afc360b71bb63c389a90614e083e94aaf788e809b72c006c7fb2f828f59677 I0423 20:04:44.130317 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=cb1a3fcf2bdcae024fbbe43ced234f580830a045d1e962c48ed403de697cb03e I0423 20:04:44.130332 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=7e2d9713370bb89e8f56312a3305a92b99918c840746342be88c7d891effe52a I0423 20:04:44.130345 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=092af502cca32f9e2c595b68255c3945ea4fb608a896554e32210ec35fa36e9d I0423 20:04:44.130367 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=605d8534f18b0384f255fa6bcacb4d3977616deb612621fe0214a8775ef63d97 I0423 20:04:44.130382 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0423 20:04:44.130389 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0423 20:04:44.130395 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.849613076s to process 35 records I0423 20:04:44.307536 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lp77x pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-lp77x\" is waiting to start: ContainerCreating" I0423 20:04:44.307552 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-lp77x\" is waiting to start: ContainerCreating" I0423 20:04:44.307580 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-t2zkq pod in namespace openshift-dns (previous: false). W0423 20:04:44.309610 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:04:44.528692 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-t2zkq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-t2zkq\" is waiting to start: ContainerCreating" I0423 20:04:44.528709 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-t2zkq\" is waiting to start: ContainerCreating" I0423 20:04:44.528717 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-t2zkq pod in namespace openshift-dns (previous: false). I0423 20:04:44.708949 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-t2zkq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-t2zkq\" is waiting to start: ContainerCreating" I0423 20:04:44.708962 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-t2zkq\" is waiting to start: ContainerCreating" I0423 20:04:44.708971 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-897hf pod in namespace openshift-dns (previous: false). I0423 20:04:44.907832 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:04:44.907850 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-jtkrb pod in namespace openshift-dns (previous: false). I0423 20:04:45.116167 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:04:45.116203 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-mbdzx pod in namespace openshift-dns (previous: false). W0423 20:04:45.309519 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:04:45.311890 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:04:45.311953 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5c6c8458fc-lts62 pod in namespace openshift-image-registry (previous: false). I0423 20:04:45.509433 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5c6c8458fc-lts62 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5c6c8458fc-lts62\" is waiting to start: ContainerCreating" I0423 20:04:45.509453 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5c6c8458fc-lts62\" is waiting to start: ContainerCreating" I0423 20:04:45.509514 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-796f7d54d6-2wfr4 pod in namespace openshift-image-registry (previous: false). I0423 20:04:45.708476 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-796f7d54d6-2wfr4 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-796f7d54d6-2wfr4\" is waiting to start: ContainerCreating" I0423 20:04:45.708495 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-796f7d54d6-2wfr4\" is waiting to start: ContainerCreating" I0423 20:04:45.708533 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-796f7d54d6-tnkvn pod in namespace openshift-image-registry (previous: false). I0423 20:04:45.909664 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-796f7d54d6-tnkvn pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-796f7d54d6-tnkvn\" is waiting to start: ContainerCreating" I0423 20:04:45.909682 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-796f7d54d6-tnkvn\" is waiting to start: ContainerCreating" I0423 20:04:45.909695 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-4cqnk pod in namespace openshift-image-registry (previous: false). I0423 20:04:46.108103 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:04:46.108119 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5qnl6 pod in namespace openshift-image-registry (previous: false). I0423 20:04:46.309296 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:04:46.309315 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-n6llt pod in namespace openshift-image-registry (previous: false). W0423 20:04:46.309763 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:04:46.513663 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:04:46.513681 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-84bb5db94-lv94d pod in namespace openshift-ingress (previous: false). I0423 20:04:46.708013 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-84bb5db94-lv94d pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-84bb5db94-lv94d\" is waiting to start: ContainerCreating" I0423 20:04:46.708031 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-84bb5db94-lv94d\" is waiting to start: ContainerCreating" I0423 20:04:46.708045 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-84bb5db94-txpsc pod in namespace openshift-ingress (previous: false). I0423 20:04:46.909110 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-84bb5db94-txpsc pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-84bb5db94-txpsc\" is waiting to start: ContainerCreating" I0423 20:04:46.909130 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-84bb5db94-txpsc\" is waiting to start: ContainerCreating" I0423 20:04:46.909145 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-86666747ff-bbkfd pod in namespace openshift-ingress (previous: false). I0423 20:04:47.108605 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-86666747ff-bbkfd pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-86666747ff-bbkfd\" is waiting to start: ContainerCreating" I0423 20:04:47.108626 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-86666747ff-bbkfd\" is waiting to start: ContainerCreating" I0423 20:04:47.108654 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-78trm pod in namespace openshift-ingress-canary (previous: false). W0423 20:04:47.306736 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0423 20:04:47.306758 1 tasks_processing.go:74] worker 54 stopped. E0423 20:04:47.306771 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0423 20:04:47.306781 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0423 20:04:47.306796 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0423 20:04:47.306804 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.026563666s to process 1 records I0423 20:04:47.308833 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-78trm pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-78trm\" is waiting to start: ContainerCreating" I0423 20:04:47.308845 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-78trm\" is waiting to start: ContainerCreating" I0423 20:04:47.308871 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-dnmjh pod in namespace openshift-ingress-canary (previous: false). I0423 20:04:47.524269 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-dnmjh pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-dnmjh\" is waiting to start: ContainerCreating" I0423 20:04:47.524287 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-dnmjh\" is waiting to start: ContainerCreating" I0423 20:04:47.524313 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mnc75 pod in namespace openshift-ingress-canary (previous: false). I0423 20:04:47.708956 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-mnc75 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mnc75\" is waiting to start: ContainerCreating" I0423 20:04:47.708973 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mnc75\" is waiting to start: ContainerCreating" I0423 20:04:47.708985 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-7d5f866c57-vzbpq pod in namespace openshift-kube-storage-version-migrator (previous: false). I0423 20:04:47.913875 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-7d5f866c57-vzbpq pod in namespace openshift-kube-storage-version-migrator (previous: false). I0423 20:04:48.109477 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74848b4cb9-zvjh4 pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0423 20:04:48.310957 1 tasks_processing.go:74] worker 18 stopped. I0423 20:04:48.311084 1 recorder.go:75] Recording events/openshift-dns with fingerprint=9592199b5510b4327ecfa2a496377c1a1a2558db8bd8dd827041788fb69e4797 I0423 20:04:48.311176 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=464fba3b8584bca315cf72485e781887d5cdae62ba9f485c21303c8d5623822b I0423 20:04:48.311203 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=805ac11f3692422a9b3995fc6ab8959385bd75544d58eff36903e47ae2760cd5 I0423 20:04:48.311250 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=e2c417afb44eed9b76e924cf99fe9d08fcab6dedf8cf1ae816e9d9025be4981e I0423 20:04:48.311267 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=b4c1ef63a0a04575b947740ca2343d9ac93af86ad102e63f126a61addc0b13bc I0423 20:04:48.311279 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=7203259f4310566e317dd98dabf0ed146795938c2fdc8a4a241ee28b4ab11e01 I0423 20:04:48.311332 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=4ee22cdce9908858aef1552049a6f8307a3df52565d061d499cd1315293a6187 I0423 20:04:48.312653 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-fv4g8 with fingerprint=ee8b3894f9e8a846d0add9fdd64fe00ab73538ef52788a44b47142e7b5408eca I0423 20:04:48.312752 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-lp77x with fingerprint=5376af29cda93e8d250ddd42645cf9a4a76622e85cc51976b692fcc6eb2a6e28 I0423 20:04:48.312827 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-t2zkq with fingerprint=ba70e264a369f6adb0d2d8b54ede7c706b0bbda9f0b51c6784b20ad675843721 I0423 20:04:48.312961 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5c6c8458fc-lts62 with fingerprint=730b7292c083fccd0cce0c925d1ae657ef4d86f869af2926bef1fdde439b9e65 I0423 20:04:48.313057 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-796f7d54d6-2wfr4 with fingerprint=180311272d1f1523ee83fb6ac09b04209c4f3654a126d23b6db6cc5645150325 I0423 20:04:48.313147 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-796f7d54d6-tnkvn with fingerprint=c8721cb5f48506bcd6d2e6b8dd85b821553369598f83f7812b73f1f242313ad7 I0423 20:04:48.313204 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-78trm with fingerprint=293df420cb6b336f35bf6db1bcfeb8d6fc649677a65a3baa730a4e2fc1456be1 I0423 20:04:48.313257 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-dnmjh with fingerprint=8cb8acd8baa45539ab24322f0f70cabb34ed2d943c083f56f939d25d022d0659 I0423 20:04:48.313313 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-mnc75 with fingerprint=97ca361db043308792df59164c45cf3ee813ad2b16e7fd36bb93267f90157b8b I0423 20:04:48.313328 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-vzbpq/migrator_current.log with fingerprint=ccd5aa9cdc9977d7423df317ba75cbdbf2924def65898ba041286c58e200f0f3 I0423 20:04:48.313333 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-vzbpq/graceful-termination_current.log with fingerprint=ab03eebbe4139f0ae327b7715ec6a7f5434a16d3186f131f2fba86bae882e2ae I0423 20:04:48.313406 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74848b4cb9-zvjh4/kube-storage-version-migrator-operator_current.log with fingerprint=d4b722c2cd759822bc45f1a4598c1178b1c99edea7d640d4a7a2b29b751d4e61 I0423 20:04:48.313415 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.031109291s to process 19 records I0423 20:04:54.691194 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:04:54.922389 1 tasks_processing.go:74] worker 61 stopped. I0423 20:04:54.922430 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0423 20:04:54.922442 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.639267411s to process 1 records I0423 20:04:55.686446 1 tasks_processing.go:74] worker 19 stopped. I0423 20:04:55.686695 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=0088e0a32371311f7e1870b984c632b0a0bea653dc12cdf0ea7947cd6c4546f3 I0423 20:04:55.686709 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.405410864s to process 1 records E0423 20:04:55.686765 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.407s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0423 20:04:55.687874 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0423 20:04:55.687888 1 periodic.go:209] Running workloads gatherer I0423 20:04:55.687919 1 tasks_processing.go:45] number of workers: 2 I0423 20:04:55.687927 1 tasks_processing.go:69] worker 1 listening for tasks. I0423 20:04:55.687933 1 tasks_processing.go:71] worker 1 working on workload_info task. I0423 20:04:55.687941 1 tasks_processing.go:69] worker 0 listening for tasks. I0423 20:04:55.687960 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0423 20:04:55.710286 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0423 20:04:55.710777 1 tasks_processing.go:74] worker 0 stopped. I0423 20:04:55.710790 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 22.798104ms to process 0 records I0423 20:04:55.723544 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (14ms) I0423 20:04:55.746033 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (22ms) I0423 20:04:55.756435 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (10ms) I0423 20:04:55.768109 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (12ms) I0423 20:04:55.778211 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (10ms) I0423 20:04:55.790412 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (12ms) I0423 20:04:55.802288 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (12ms) I0423 20:04:55.811117 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (9ms) I0423 20:04:55.820215 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (9ms) I0423 20:04:55.828996 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (9ms) I0423 20:04:55.839753 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (11ms) I0423 20:04:55.921511 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (82ms) I0423 20:04:56.019309 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (98ms) I0423 20:04:56.119416 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0423 20:04:56.220539 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (101ms) I0423 20:04:56.335891 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (115ms) I0423 20:04:56.423187 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (87ms) I0423 20:04:56.522194 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0423 20:04:56.620177 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (98ms) I0423 20:04:56.720256 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0423 20:04:56.820095 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0423 20:04:56.921190 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (101ms) I0423 20:04:57.020401 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (99ms) I0423 20:04:57.122440 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (102ms) I0423 20:04:57.219750 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (97ms) I0423 20:04:57.321115 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0423 20:04:57.423031 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (102ms) I0423 20:04:57.520244 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (97ms) I0423 20:04:57.620582 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0423 20:04:57.719962 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (99ms) I0423 20:04:57.821359 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (101ms) I0423 20:04:57.921880 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms) I0423 20:04:57.921925 1 tasks_processing.go:74] worker 1 stopped. E0423 20:04:57.921939 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0423 20:04:57.922236 1 recorder.go:75] Recording config/workload_info with fingerprint=2f4cf0317636f7c2bca18d146a7eb4ff0fded4f4faffacfbdd67470ea03137e8 I0423 20:04:57.922252 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.233984901s to process 1 records E0423 20:04:57.922277 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.234s with: function \"workload_info\" failed with an error" I0423 20:04:57.923376 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0423 20:04:57.923388 1 periodic.go:209] Running conditional gatherer I0423 20:04:57.929486 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0423 20:04:57.936081 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:39078->172.30.0.10:53: read: connection refused E0423 20:04:57.936323 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:04:57.936393 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0423 20:04:57.944011 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0423 20:04:57.944023 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:04:57.944029 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:04:57.944033 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:04:57.944036 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:04:57.944039 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:04:57.944042 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:04:57.944045 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:04:57.944047 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:04:57.944050 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0423 20:04:57.944066 1 tasks_processing.go:45] number of workers: 3 I0423 20:04:57.944073 1 tasks_processing.go:69] worker 2 listening for tasks. I0423 20:04:57.944076 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0423 20:04:57.944081 1 tasks_processing.go:69] worker 0 listening for tasks. I0423 20:04:57.944091 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0423 20:04:57.944099 1 tasks_processing.go:69] worker 1 listening for tasks. I0423 20:04:57.944116 1 tasks_processing.go:74] worker 1 stopped. I0423 20:04:57.944117 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0423 20:04:57.944127 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0423 20:04:57.944137 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 937ns to process 1 records I0423 20:04:57.944192 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0423 20:04:57.944200 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.448µs to process 1 records I0423 20:04:57.944206 1 tasks_processing.go:74] worker 2 stopped. I0423 20:04:57.944331 1 tasks_processing.go:74] worker 0 stopped. I0423 20:04:57.944345 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 231.736µs to process 0 records I0423 20:04:57.944368 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:39078->172.30.0.10:53: read: connection refused I0423 20:04:57.944386 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0423 20:04:57.946858 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:04:57.966679 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=3d9e0b2a421fa222e69ae49f51b27c4822b738a31054c9f8d42961fce99db508 I0423 20:04:57.966850 1 diskrecorder.go:70] Writing 113 records to /var/lib/insights-operator/insights-2026-04-23-200457.tar.gz I0423 20:04:57.975195 1 diskrecorder.go:51] Wrote 113 records to disk in 8ms I0423 20:04:57.975227 1 periodic.go:278] Gathering cluster info every 2h0m0s I0423 20:04:57.975242 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0423 20:04:58.145648 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:05:10.310482 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:06:01.552327 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="cfce343ebcd5b489b86f55079afb878d9b4d5c65847ed79dc37c9fe8c12dde0d") W0423 20:06:01.552369 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0423 20:06:01.552434 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="06b4a492d888e8fbbd0081faeed0f451cff4c55f37a1dea65e7dbb730d309202") I0423 20:06:01.552442 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0423 20:06:01.552466 1 periodic.go:170] Shutting down I0423 20:06:01.552486 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped"