W0420 17:30:06.233967 1 cmd.go:257] Using insecure, self-signed certificates I0420 17:30:06.598190 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 17:30:06.598580 1 observer_polling.go:159] Starting file observer I0420 17:30:07.101345 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0420 17:30:07.101540 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0420 17:30:07.102097 1 secure_serving.go:57] Forcing use of http/1.1 only W0420 17:30:07.102118 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0420 17:30:07.102124 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0420 17:30:07.102129 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0420 17:30:07.102131 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0420 17:30:07.102135 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0420 17:30:07.102138 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0420 17:30:07.102140 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0420 17:30:07.108905 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0420 17:30:07.108972 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"68843adf-4e81-4e6d-9a85-490c21aa2909", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0420 17:30:07.110438 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0420 17:30:07.110447 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0420 17:30:07.110446 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0420 17:30:07.110470 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0420 17:30:07.110471 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0420 17:30:07.110473 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0420 17:30:07.110772 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-173811080/tls.crt::/tmp/serving-cert-173811080/tls.key" I0420 17:30:07.111067 1 secure_serving.go:213] Serving securely on [::]:8443 I0420 17:30:07.111095 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0420 17:30:07.115548 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0420 17:30:07.115574 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0420 17:30:07.115696 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0420 17:30:07.124765 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0420 17:30:07.124796 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0420 17:30:07.131985 1 secretconfigobserver.go:119] support secret does not exist I0420 17:30:07.138225 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0420 17:30:07.142966 1 secretconfigobserver.go:119] support secret does not exist I0420 17:30:07.146220 1 recorder.go:176] Pruning old reports every 4h15m3s, max age is 288h0m0s I0420 17:30:07.151788 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0420 17:30:07.151793 1 periodic.go:216] Running clusterconfig gatherer I0420 17:30:07.151806 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0420 17:30:07.151825 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0420 17:30:07.151832 1 insightsreport.go:296] Starting report retriever I0420 17:30:07.151836 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0420 17:30:07.151838 1 tasks_processing.go:45] number of workers: 64 I0420 17:30:07.151862 1 tasks_processing.go:69] worker 3 listening for tasks. I0420 17:30:07.151871 1 tasks_processing.go:69] worker 0 listening for tasks. I0420 17:30:07.151873 1 tasks_processing.go:69] worker 7 listening for tasks. I0420 17:30:07.151877 1 tasks_processing.go:69] worker 1 listening for tasks. I0420 17:30:07.151883 1 tasks_processing.go:69] worker 2 listening for tasks. I0420 17:30:07.151883 1 tasks_processing.go:69] worker 4 listening for tasks. I0420 17:30:07.151890 1 tasks_processing.go:69] worker 10 listening for tasks. I0420 17:30:07.151898 1 tasks_processing.go:71] worker 10 working on node_logs task. I0420 17:30:07.151899 1 tasks_processing.go:71] worker 4 working on overlapping_namespace_uids task. I0420 17:30:07.151901 1 tasks_processing.go:69] worker 8 listening for tasks. I0420 17:30:07.151895 1 tasks_processing.go:69] worker 9 listening for tasks. I0420 17:30:07.151879 1 tasks_processing.go:69] worker 12 listening for tasks. I0420 17:30:07.151897 1 tasks_processing.go:69] worker 6 listening for tasks. I0420 17:30:07.151912 1 tasks_processing.go:69] worker 40 listening for tasks. I0420 17:30:07.151914 1 tasks_processing.go:69] worker 11 listening for tasks. I0420 17:30:07.151913 1 tasks_processing.go:69] worker 54 listening for tasks. I0420 17:30:07.151922 1 tasks_processing.go:69] worker 48 listening for tasks. I0420 17:30:07.151926 1 tasks_processing.go:69] worker 14 listening for tasks. I0420 17:30:07.151928 1 tasks_processing.go:69] worker 51 listening for tasks. I0420 17:30:07.151919 1 tasks_processing.go:69] worker 13 listening for tasks. I0420 17:30:07.151930 1 tasks_processing.go:69] worker 52 listening for tasks. I0420 17:30:07.151933 1 tasks_processing.go:69] worker 53 listening for tasks. I0420 17:30:07.151938 1 tasks_processing.go:69] worker 15 listening for tasks. I0420 17:30:07.151941 1 tasks_processing.go:69] worker 49 listening for tasks. I0420 17:30:07.151943 1 tasks_processing.go:69] worker 50 listening for tasks. I0420 17:30:07.151889 1 tasks_processing.go:69] worker 5 listening for tasks. I0420 17:30:07.151945 1 tasks_processing.go:69] worker 47 listening for tasks. I0420 17:30:07.151958 1 tasks_processing.go:69] worker 61 listening for tasks. I0420 17:30:07.151954 1 tasks_processing.go:69] worker 43 listening for tasks. I0420 17:30:07.151960 1 tasks_processing.go:69] worker 18 listening for tasks. I0420 17:30:07.151969 1 tasks_processing.go:69] worker 55 listening for tasks. I0420 17:30:07.151944 1 tasks_processing.go:69] worker 16 listening for tasks. I0420 17:30:07.151974 1 tasks_processing.go:69] worker 26 listening for tasks. I0420 17:30:07.151963 1 tasks_processing.go:69] worker 23 listening for tasks. I0420 17:30:07.151951 1 tasks_processing.go:69] worker 28 listening for tasks. I0420 17:30:07.151983 1 tasks_processing.go:69] worker 56 listening for tasks. I0420 17:30:07.151979 1 tasks_processing.go:69] worker 24 listening for tasks. I0420 17:30:07.151979 1 tasks_processing.go:69] worker 42 listening for tasks. I0420 17:30:07.151991 1 tasks_processing.go:69] worker 57 listening for tasks. I0420 17:30:07.151992 1 tasks_processing.go:69] worker 20 listening for tasks. I0420 17:30:07.151993 1 tasks_processing.go:69] worker 46 listening for tasks. I0420 17:30:07.151998 1 tasks_processing.go:69] worker 58 listening for tasks. I0420 17:30:07.151986 1 tasks_processing.go:69] worker 31 listening for tasks. I0420 17:30:07.152003 1 tasks_processing.go:69] worker 63 listening for tasks. I0420 17:30:07.152002 1 tasks_processing.go:69] worker 22 listening for tasks. I0420 17:30:07.151960 1 tasks_processing.go:69] worker 29 listening for tasks. I0420 17:30:07.152010 1 tasks_processing.go:71] worker 3 working on qemu_kubevirt_launcher_logs task. I0420 17:30:07.152010 1 tasks_processing.go:69] worker 34 listening for tasks. I0420 17:30:07.152014 1 tasks_processing.go:69] worker 59 listening for tasks. I0420 17:30:07.152005 1 tasks_processing.go:69] worker 27 listening for tasks. I0420 17:30:07.152016 1 tasks_processing.go:71] worker 2 working on metrics task. I0420 17:30:07.152020 1 tasks_processing.go:69] worker 35 listening for tasks. I0420 17:30:07.152027 1 tasks_processing.go:69] worker 60 listening for tasks. I0420 17:30:07.151969 1 tasks_processing.go:69] worker 44 listening for tasks. I0420 17:30:07.151973 1 tasks_processing.go:69] worker 25 listening for tasks. I0420 17:30:07.152030 1 tasks_processing.go:69] worker 38 listening for tasks. I0420 17:30:07.151979 1 tasks_processing.go:69] worker 30 listening for tasks. I0420 17:30:07.152030 1 tasks_processing.go:69] worker 21 listening for tasks. W0420 17:30:07.152044 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 17:30:07.152060 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 26.874µs to process 0 records I0420 17:30:07.151985 1 tasks_processing.go:69] worker 19 listening for tasks. I0420 17:30:07.151979 1 tasks_processing.go:69] worker 45 listening for tasks. I0420 17:30:07.151951 1 tasks_processing.go:69] worker 17 listening for tasks. I0420 17:30:07.151988 1 tasks_processing.go:71] worker 0 working on networks task. I0420 17:30:07.151992 1 tasks_processing.go:71] worker 1 working on proxies task. I0420 17:30:07.152104 1 tasks_processing.go:71] worker 58 working on monitoring_persistent_volumes task. I0420 17:30:07.152107 1 tasks_processing.go:71] worker 63 working on nodes task. I0420 17:30:07.152109 1 tasks_processing.go:71] worker 13 working on machine_sets task. I0420 17:30:07.152107 1 tasks_processing.go:71] worker 14 working on openstack_dataplanenodesets task. I0420 17:30:07.152104 1 tasks_processing.go:71] worker 31 working on node_features task. I0420 17:30:07.152165 1 tasks_processing.go:71] worker 8 working on storage_cluster task. I0420 17:30:07.151993 1 tasks_processing.go:69] worker 32 listening for tasks. I0420 17:30:07.152183 1 tasks_processing.go:71] worker 32 working on nodenetworkconfigurationpolicies task. I0420 17:30:07.151995 1 tasks_processing.go:69] worker 62 listening for tasks. I0420 17:30:07.152190 1 tasks_processing.go:71] worker 26 working on ingress_certificates task. I0420 17:30:07.152196 1 tasks_processing.go:71] worker 52 working on install_plans task. I0420 17:30:07.152203 1 tasks_processing.go:71] worker 54 working on cost_management_metrics_configs task. I0420 17:30:07.152250 1 tasks_processing.go:71] worker 24 working on support_secret task. I0420 17:30:07.152263 1 tasks_processing.go:71] worker 9 working on openstack_dataplanedeployments task. I0420 17:30:07.152266 1 tasks_processing.go:71] worker 62 working on aggregated_monitoring_cr_names task. I0420 17:30:07.152322 1 tasks_processing.go:71] worker 48 working on openshift_logging task. I0420 17:30:07.152334 1 tasks_processing.go:71] worker 57 working on pdbs task. I0420 17:30:07.152374 1 tasks_processing.go:71] worker 20 working on certificate_signing_requests task. I0420 17:30:07.152383 1 tasks_processing.go:71] worker 12 working on machine_autoscalers task. I0420 17:30:07.151949 1 tasks_processing.go:69] worker 41 listening for tasks. I0420 17:30:07.152399 1 tasks_processing.go:71] worker 41 working on active_alerts task. I0420 17:30:07.152415 1 tasks_processing.go:71] worker 40 working on openstack_controlplanes task. W0420 17:30:07.152422 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 17:30:07.152435 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 24.333µs to process 0 records I0420 17:30:07.152010 1 tasks_processing.go:69] worker 36 listening for tasks. I0420 17:30:07.152441 1 tasks_processing.go:71] worker 42 working on oauths task. I0420 17:30:07.152002 1 tasks_processing.go:69] worker 33 listening for tasks. I0420 17:30:07.152452 1 tasks_processing.go:71] worker 41 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0420 17:30:07.152456 1 tasks_processing.go:71] worker 33 working on lokistack task. I0420 17:30:07.152503 1 tasks_processing.go:71] worker 28 working on authentication task. I0420 17:30:07.152535 1 tasks_processing.go:71] worker 46 working on machines task. I0420 17:30:07.152018 1 tasks_processing.go:69] worker 39 listening for tasks. I0420 17:30:07.152567 1 tasks_processing.go:71] worker 11 working on cluster_apiserver task. I0420 17:30:07.152100 1 tasks_processing.go:71] worker 17 working on mutating_webhook_configurations task. I0420 17:30:07.152593 1 tasks_processing.go:71] worker 43 working on silenced_alerts task. I0420 17:30:07.152598 1 tasks_processing.go:71] worker 56 working on dvo_metrics task. I0420 17:30:07.152606 1 tasks_processing.go:71] worker 22 working on jaegers task. W0420 17:30:07.152621 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 17:30:07.152630 1 tasks_processing.go:71] worker 43 working on storage_classes task. I0420 17:30:07.152638 1 tasks_processing.go:71] worker 23 working on openstack_version task. I0420 17:30:07.152010 1 tasks_processing.go:69] worker 37 listening for tasks. I0420 17:30:07.152160 1 tasks_processing.go:71] worker 6 working on infrastructures task. I0420 17:30:07.152765 1 tasks_processing.go:71] worker 29 working on config_maps task. I0420 17:30:07.152812 1 tasks_processing.go:71] worker 55 working on openshift_machine_api_events task. I0420 17:30:07.151995 1 tasks_processing.go:71] worker 7 working on nodenetworkstates task. I0420 17:30:07.152843 1 tasks_processing.go:71] worker 16 working on feature_gates task. I0420 17:30:07.152940 1 tasks_processing.go:71] worker 5 working on sap_pods task. I0420 17:30:07.152098 1 tasks_processing.go:71] worker 50 working on operators task. I0420 17:30:07.152448 1 tasks_processing.go:71] worker 36 working on sap_config task. I0420 17:30:07.152105 1 tasks_processing.go:71] worker 51 working on crds task. I0420 17:30:07.152597 1 tasks_processing.go:71] worker 39 working on tsdb_status task. I0420 17:30:07.153007 1 tasks_processing.go:71] worker 25 working on ceph_cluster task. W0420 17:30:07.153068 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 17:30:07.153092 1 tasks_processing.go:71] worker 21 working on version task. I0420 17:30:07.153099 1 tasks_processing.go:71] worker 2 working on machine_config_pools task. I0420 17:30:07.153104 1 tasks_processing.go:71] worker 49 working on service_accounts task. I0420 17:30:07.153124 1 tasks_processing.go:71] worker 38 working on olm_operators task. I0420 17:30:07.152602 1 tasks_processing.go:71] worker 44 working on machine_configs task. I0420 17:30:07.153153 1 tasks_processing.go:71] worker 34 working on image_registries task. I0420 17:30:07.153195 1 tasks_processing.go:71] worker 45 working on machine_healthchecks task. I0420 17:30:07.153201 1 tasks_processing.go:71] worker 18 working on container_images task. I0420 17:30:07.153237 1 tasks_processing.go:71] worker 30 working on ingress task. I0420 17:30:07.153238 1 tasks_processing.go:71] worker 53 working on schedulers task. I0420 17:30:07.153093 1 tasks_processing.go:71] worker 19 working on clusterroles task. I0420 17:30:07.153283 1 tasks_processing.go:71] worker 59 working on image task. I0420 17:30:07.153308 1 tasks_processing.go:71] worker 61 working on operators_pods_and_events task. I0420 17:30:07.153333 1 tasks_processing.go:71] worker 35 working on validating_webhook_configurations task. I0420 17:30:07.153497 1 tasks_processing.go:71] worker 15 working on container_runtime_configs task. I0420 17:30:07.153521 1 tasks_processing.go:71] worker 60 working on sap_datahubs task. I0420 17:30:07.153277 1 tasks_processing.go:71] worker 27 working on pod_network_connectivity_checks task. I0420 17:30:07.154023 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 23.518µs to process 0 records I0420 17:30:07.154105 1 tasks_processing.go:71] worker 47 working on image_pruners task. I0420 17:30:07.154178 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 85.843µs to process 0 records I0420 17:30:07.154349 1 tasks_processing.go:74] worker 39 stopped. I0420 17:30:07.155198 1 tasks_processing.go:74] worker 37 stopped. E0420 17:30:07.156776 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0420 17:30:07.156792 1 tasks_processing.go:74] worker 31 stopped. I0420 17:30:07.156805 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 4.62197ms to process 0 records I0420 17:30:07.164192 1 tasks_processing.go:74] worker 14 stopped. I0420 17:30:07.164209 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 12.06923ms to process 0 records I0420 17:30:07.164218 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 12.01833ms to process 0 records I0420 17:30:07.164225 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 11.364902ms to process 0 records I0420 17:30:07.164230 1 tasks_processing.go:74] worker 8 stopped. I0420 17:30:07.164231 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 11.778553ms to process 0 records I0420 17:30:07.164237 1 tasks_processing.go:74] worker 40 stopped. I0420 17:30:07.164237 1 tasks_processing.go:74] worker 7 stopped. I0420 17:30:07.164243 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 12.012133ms to process 0 records I0420 17:30:07.164253 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 11.955748ms to process 0 records I0420 17:30:07.164255 1 tasks_processing.go:74] worker 54 stopped. I0420 17:30:07.164260 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 12.04645ms to process 0 records I0420 17:30:07.164261 1 tasks_processing.go:74] worker 9 stopped. I0420 17:30:07.164266 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 11.846559ms to process 0 records I0420 17:30:07.164270 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 11.78206ms to process 0 records I0420 17:30:07.164273 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 12.138692ms to process 0 records I0420 17:30:07.164276 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 11.92871ms to process 0 records I0420 17:30:07.164281 1 tasks_processing.go:74] worker 48 stopped. I0420 17:30:07.164284 1 tasks_processing.go:74] worker 32 stopped. I0420 17:30:07.164287 1 tasks_processing.go:74] worker 12 stopped. I0420 17:30:07.164290 1 tasks_processing.go:74] worker 33 stopped. I0420 17:30:07.164294 1 tasks_processing.go:74] worker 13 stopped. I0420 17:30:07.165096 1 tasks_processing.go:74] worker 22 stopped. I0420 17:30:07.165112 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 12.480343ms to process 0 records I0420 17:30:07.165357 1 tasks_processing.go:74] worker 2 stopped. I0420 17:30:07.165366 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 12.249371ms to process 0 records I0420 17:30:07.165374 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 12.382324ms to process 0 records I0420 17:30:07.165383 1 tasks_processing.go:74] worker 36 stopped. I0420 17:30:07.165529 1 tasks_processing.go:74] worker 1 stopped. I0420 17:30:07.165612 1 recorder.go:75] Recording config/proxy with fingerprint=b497273f25a5e8fac4b88fda593465a8167f00b4f29b2b5523af2e44a0f14fb9 I0420 17:30:07.165625 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 13.416029ms to process 1 records I0420 17:30:07.165693 1 tasks_processing.go:74] worker 45 stopped. E0420 17:30:07.165704 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0420 17:30:07.165712 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 12.477876ms to process 0 records I0420 17:30:07.165917 1 tasks_processing.go:74] worker 23 stopped. I0420 17:30:07.165925 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 13.251076ms to process 0 records I0420 17:30:07.166026 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0420 17:30:07.166045 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0420 17:30:07.166051 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0420 17:30:07.166055 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0420 17:30:07.166076 1 controller.go:531] The operator is still being initialized I0420 17:30:07.166086 1 controller.go:554] The operator is healthy I0420 17:30:07.169115 1 tasks_processing.go:74] worker 6 stopped. I0420 17:30:07.169637 1 recorder.go:75] Recording config/infrastructure with fingerprint=4c92739b0dc18bc74472c22820b07d78bbc600eea87fbe64eaa9505f63bd4ab3 I0420 17:30:07.169673 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 16.380361ms to process 1 records I0420 17:30:07.169694 1 tasks_processing.go:74] worker 42 stopped. I0420 17:30:07.169867 1 recorder.go:75] Recording config/oauth with fingerprint=bdbf718f39127a5386cfec8ea6aad01f432c172ceb5649e2b4f7d61dd874bece I0420 17:30:07.169879 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 17.242286ms to process 1 records I0420 17:30:07.170657 1 tasks_processing.go:74] worker 24 stopped. E0420 17:30:07.170667 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0420 17:30:07.170673 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 18.374641ms to process 0 records I0420 17:30:07.171134 1 tasks_processing.go:74] worker 57 stopped. I0420 17:30:07.171176 1 gather_logs.go:145] no pods in namespace were found I0420 17:30:07.171295 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=e17c1c31d50fd7b3acd9da794a8bdfeda70517d6a627154ba6a47f5bbf6e4d58 I0420 17:30:07.171325 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=42d6d0527bc149122f0a6c86c8f856f8e86082aaddfb6e57c58677d2b7927bbe I0420 17:30:07.171350 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=871c305da0cff87d2f4996497b67c8b119d5e396584024f837f5c98ee772efeb I0420 17:30:07.171362 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 18.789764ms to process 3 records I0420 17:30:07.171374 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 19.169286ms to process 0 records I0420 17:30:07.171383 1 tasks_processing.go:74] worker 3 stopped. I0420 17:30:07.171406 1 tasks_processing.go:74] worker 28 stopped. I0420 17:30:07.171575 1 recorder.go:75] Recording config/authentication with fingerprint=7199e565002d465d9b608b5fefe53fa5fd36d677c745faa8fe95029bfb895ac6 I0420 17:30:07.171589 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 18.887273ms to process 1 records I0420 17:30:07.171599 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 19.532446ms to process 0 records I0420 17:30:07.171613 1 tasks_processing.go:74] worker 10 stopped. I0420 17:30:07.171670 1 tasks_processing.go:74] worker 11 stopped. I0420 17:30:07.171849 1 recorder.go:75] Recording config/apiserver with fingerprint=3d0206ad675f3b9bd3eb88f1145e3906b31e878606b86db46a980860b0ef561d I0420 17:30:07.171864 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 19.089375ms to process 1 records I0420 17:30:07.172195 1 tasks_processing.go:74] worker 27 stopped. E0420 17:30:07.172208 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0420 17:30:07.172214 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 18.325188ms to process 0 records I0420 17:30:07.172220 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 19.24553ms to process 0 records I0420 17:30:07.172224 1 tasks_processing.go:74] worker 5 stopped. I0420 17:30:07.172231 1 tasks_processing.go:74] worker 16 stopped. I0420 17:30:07.172383 1 recorder.go:75] Recording config/featuregate with fingerprint=e1df0d6379ad25332e9f8a69774639ac6b76395606439cbe492e81362b54ab09 I0420 17:30:07.172401 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 19.379697ms to process 1 records E0420 17:30:07.172418 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0420 17:30:07.172426 1 gather.go:177] gatherer "clusterconfig" function "machines" took 19.69501ms to process 0 records I0420 17:30:07.172435 1 tasks_processing.go:74] worker 46 stopped. I0420 17:30:07.172490 1 tasks_processing.go:74] worker 0 stopped. I0420 17:30:07.172668 1 recorder.go:75] Recording config/network with fingerprint=6347585d3a59150ba8f005a54ad7c12732bb3cdeaa25d98d61fbbf0f7454550b I0420 17:30:07.172687 1 gather.go:177] gatherer "clusterconfig" function "networks" took 20.403101ms to process 1 records I0420 17:30:07.172873 1 tasks_processing.go:74] worker 63 stopped. I0420 17:30:07.173139 1 recorder.go:75] Recording config/node/ip-10-0-0-232.ec2.internal with fingerprint=6e0f94e5739cf41bd8f9ebeb45b5438ee97c3a0300d6ba99412e51922f61198f I0420 17:30:07.173194 1 recorder.go:75] Recording config/node/ip-10-0-1-175.ec2.internal with fingerprint=a70f8f500a6b676a8226c1cf2d37b3a99949403ac23d518b5c428e2a2616b143 I0420 17:30:07.173249 1 recorder.go:75] Recording config/node/ip-10-0-2-74.ec2.internal with fingerprint=9381ed85f907f542e9f99b68fc3bab4481025e3f2b14708ad1ba127b0fd96a35 I0420 17:30:07.173262 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 20.751897ms to process 3 records I0420 17:30:07.175542 1 tasks_processing.go:74] worker 15 stopped. I0420 17:30:07.175560 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 22.022905ms to process 0 records I0420 17:30:07.175660 1 tasks_processing.go:74] worker 43 stopped. I0420 17:30:07.175663 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=b3608ea920df28c5b938f43fcfd026ed0159334826c5ddb4baa1443225646ccc I0420 17:30:07.175681 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=678569278440cba3881c2fec5978ce53eb49c52dd699f70e693b7de8ab00c62a I0420 17:30:07.175691 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 22.916224ms to process 2 records I0420 17:30:07.176686 1 tasks_processing.go:74] worker 60 stopped. I0420 17:30:07.176700 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 23.153437ms to process 0 records I0420 17:30:07.176741 1 tasks_processing.go:74] worker 55 stopped. I0420 17:30:07.176752 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 23.917031ms to process 0 records I0420 17:30:07.176774 1 tasks_processing.go:74] worker 58 stopped. I0420 17:30:07.176791 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 24.659466ms to process 0 records I0420 17:30:07.176819 1 tasks_processing.go:74] worker 25 stopped. I0420 17:30:07.176829 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 23.794795ms to process 0 records I0420 17:30:07.177620 1 tasks_processing.go:74] worker 17 stopped. I0420 17:30:07.177896 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=b6f4e1bab0d3a7b57613d115f53ef62518f57acda909e249d1cb97a3bd9a5c7a I0420 17:30:07.177999 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=aca9f7cfc1e920fed17d269feb865840b011c5105a838fe2d62e5d6ce4f54142 I0420 17:30:07.178061 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=75d6a8c4f04acad462f4b58c4b743e53870ef2ee5991ea846729337edf336048 I0420 17:30:07.178097 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 24.968867ms to process 3 records I0420 17:30:07.179787 1 tasks_processing.go:74] worker 4 stopped. I0420 17:30:07.179819 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0420 17:30:07.179831 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 27.876431ms to process 1 records I0420 17:30:07.180104 1 tasks_processing.go:74] worker 59 stopped. I0420 17:30:07.180203 1 recorder.go:75] Recording config/image with fingerprint=79af7f54ebd6a3f0a612573b7d36152e2cb18b072efc7c3507d85a7f6700682d I0420 17:30:07.180222 1 gather.go:177] gatherer "clusterconfig" function "image" took 26.805791ms to process 1 records I0420 17:30:07.181273 1 tasks_processing.go:74] worker 44 stopped. E0420 17:30:07.181286 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0420 17:30:07.181337 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0420 17:30:07.181346 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 28.114002ms to process 1 records I0420 17:30:07.181388 1 tasks_processing.go:74] worker 20 stopped. I0420 17:30:07.181407 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 28.991388ms to process 0 records I0420 17:30:07.181467 1 tasks_processing.go:74] worker 30 stopped. I0420 17:30:07.181594 1 recorder.go:75] Recording config/ingress with fingerprint=5c37d3b1f4b3c6cd0bfaf956a636777905df25b410ffcae06198cf1032628b17 I0420 17:30:07.181606 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 28.21613ms to process 1 records W0420 17:30:07.182949 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 17:30:07.183560 1 tasks_processing.go:74] worker 47 stopped. I0420 17:30:07.183752 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=e7dd921d57359e2f886fe98033493a114cd348dafbb0a0aae9ab86c204e921df I0420 17:30:07.183764 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 29.426182ms to process 1 records I0420 17:30:07.185988 1 tasks_processing.go:74] worker 35 stopped. I0420 17:30:07.186111 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=d68d0c4413270d341680e055956bcf588398699ed7b55ac43acb73f13c1825fc I0420 17:30:07.186212 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=ed124a0c240e264bd510d1d8f9d7bc4ce581aaca3cb8fafea340cfc2f69c82b6 I0420 17:30:07.186235 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=e533a3e2b195605017443189f9a99b01992241d4b11d4f7242389dbf3b850dac I0420 17:30:07.186260 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=1209e9cdbfbb45b39a83267902c0b06b510e15b218d279153d7c827590b764aa I0420 17:30:07.186282 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=0d01c07eaa02c199fdf24cbd7bc1c67e8a01d1404f2c951f9a18e8af51240b15 I0420 17:30:07.186305 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=a2bc765050789c9d15f6ec0564506d86c5421232d3602baf8977bc92472462e9 I0420 17:30:07.186353 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=e04a4ec70dd1c14580dc1401f1d19216ddea638a4282b1a7b696a4cc75abb708 I0420 17:30:07.186386 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=032aa9b94856cada0526b898b7c7ba4fa9db8b0fefe7aad195a2082facbf0c57 I0420 17:30:07.186409 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=5e9244dad664893b833c39903e29ec63dc7966b69449143126d5d6bb6b85ba91 I0420 17:30:07.186431 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=4820a337f2ea1b8bd7c5d9b99d983853c92fab09b3c9c22a7d1defab9ce91a53 I0420 17:30:07.186453 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=4fbba56f0a7a72f0094cb014a0539d3f60d8dfdf33adeefc7d89a2d39d0e1852 I0420 17:30:07.186462 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 32.641766ms to process 11 records I0420 17:30:07.187823 1 tasks_processing.go:74] worker 38 stopped. I0420 17:30:07.187837 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 34.689413ms to process 0 records I0420 17:30:07.188135 1 tasks_processing.go:74] worker 53 stopped. I0420 17:30:07.188221 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=a6020dc0da4d4effd4ff487d7d3125c38a5c8eeb3dc30c2ed0d7d15e6c2d7140 I0420 17:30:07.188232 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 34.875828ms to process 1 records I0420 17:30:07.191964 1 tasks_processing.go:74] worker 51 stopped. I0420 17:30:07.193680 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0420 17:30:07.193846 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0420 17:30:07.194501 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=fa939d2b56bd3cdda9c1bfc6f096932d3c021dc7541e29d500d31aecbd91b692 I0420 17:30:07.195638 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=9cd49d380daf83065a5dce7df17c6622f513db478a82c7beaff261d546fb86c2 I0420 17:30:07.195700 1 gather.go:177] gatherer "clusterconfig" function "crds" took 38.971821ms to process 2 records I0420 17:30:07.195722 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 40.082571ms to process 0 records I0420 17:30:07.195744 1 tasks_processing.go:74] worker 62 stopped. W0420 17:30:07.195863 1 operator.go:328] started I0420 17:30:07.195878 1 tasks_processing.go:74] worker 34 stopped. I0420 17:30:07.195897 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0420 17:30:07.196938 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=5dd64faca40d7f27a7db37c2f977b5fd098deb0597f4034e2fa08a62508d3f5f I0420 17:30:07.196956 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 42.314962ms to process 1 records I0420 17:30:07.198217 1 tasks_processing.go:74] worker 19 stopped. I0420 17:30:07.198415 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b87632ec1989e9c223f285bac33279efe0ba7af57f6d432dbc13d5eabe241aee I0420 17:30:07.198513 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=72430ec24e979e533a5a3a421bcba66277319d597592f56d1b140089a8327f78 I0420 17:30:07.198522 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 44.926683ms to process 2 records I0420 17:30:07.203959 1 tasks_processing.go:74] worker 41 stopped. I0420 17:30:07.203984 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 51.494067ms to process 0 records I0420 17:30:07.204481 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0420 17:30:07.204511 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0420 17:30:07.204518 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0420 17:30:07.204523 1 controller.go:254] Source scaController *sca.Controller is not ready I0420 17:30:07.204526 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0420 17:30:07.204545 1 controller.go:531] The operator is still being initialized I0420 17:30:07.204569 1 controller.go:554] The operator is healthy I0420 17:30:07.208284 1 prometheus_rules.go:88] Prometheus rules successfully created I0420 17:30:07.210528 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0420 17:30:07.210534 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0420 17:30:07.210587 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0420 17:30:07.210849 1 tasks_processing.go:74] worker 18 stopped. I0420 17:30:07.210907 1 recorder.go:75] Recording config/running_containers with fingerprint=d5ba6c3b6af86d093e38d2acc0348963499bf2a2548da194481e5658642c6b28 I0420 17:30:07.210919 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 57.629744ms to process 1 records E0420 17:30:07.213247 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27a2b8c80f-3c8b-4f37-ac7a-ebd91e46b387%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.16:51543->172.30.0.10:53: read: connection refused I0420 17:30:07.213263 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27a2b8c80f-3c8b-4f37-ac7a-ebd91e46b387%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.16:51543->172.30.0.10:53: read: connection refused I0420 17:30:07.215769 1 tasks_processing.go:74] worker 29 stopped. E0420 17:30:07.215783 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0420 17:30:07.215788 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found I0420 17:30:07.215787 1 base_controller.go:82] Caches are synced for ConfigController E0420 17:30:07.215792 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0420 17:30:07.215797 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0420 17:30:07.215802 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0420 17:30:07.215834 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0420 17:30:07.215841 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0420 17:30:07.215844 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0420 17:30:07.215848 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0420 17:30:07.215885 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0420 17:30:07.215892 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0420 17:30:07.215897 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 62.983585ms to process 7 records I0420 17:30:07.225744 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 17:30:07.266427 1 tasks_processing.go:74] worker 21 stopped. I0420 17:30:07.266694 1 recorder.go:75] Recording config/version with fingerprint=fc255053eef7863a034ce6aa3cb550b10028026674b3033d65af650fc553b29a I0420 17:30:07.266707 1 recorder.go:75] Recording config/id with fingerprint=ec97288b39e84f44461c1b9aa13dbb513e9396d947a0a94d8e046cc80883a6d3 I0420 17:30:07.266714 1 gather.go:177] gatherer "clusterconfig" function "version" took 113.2977ms to process 2 records I0420 17:30:07.277800 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0420 17:30:07.281333 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.16:46346->172.30.0.10:53: read: connection refused I0420 17:30:07.281345 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.16:46346->172.30.0.10:53: read: connection refused I0420 17:30:07.295768 1 tasks_processing.go:74] worker 26 stopped. E0420 17:30:07.295784 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0420 17:30:07.295789 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pq11uk25d5fjoavv3elkbmn62b0e22a-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pq11uk25d5fjoavv3elkbmn62b0e22a-primary-cert-bundle-secret" not found I0420 17:30:07.295835 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=0b068f362460b912b7ba7c92d0a95dbbc664fced3f732ae70e77f0b1b3ea64a5 I0420 17:30:07.295848 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 143.563862ms to process 1 records I0420 17:30:07.296807 1 base_controller.go:82] Caches are synced for LoggingSyncer I0420 17:30:07.296820 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0420 17:30:07.608854 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0420 17:30:07.608871 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0420 17:30:07.609193 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-flpvw pod in namespace openshift-dns (previous: false). I0420 17:30:07.835975 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-flpvw pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-flpvw\" is waiting to start: ContainerCreating" I0420 17:30:07.835993 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-flpvw\" is waiting to start: ContainerCreating" I0420 17:30:07.836004 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-flpvw pod in namespace openshift-dns (previous: false). I0420 17:30:08.006026 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-flpvw pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-flpvw\" is waiting to start: ContainerCreating" I0420 17:30:08.006041 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-flpvw\" is waiting to start: ContainerCreating" I0420 17:30:08.006053 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-mkzvg pod in namespace openshift-dns (previous: false). W0420 17:30:08.180785 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 17:30:08.200578 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mkzvg pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-mkzvg\" is waiting to start: ContainerCreating" I0420 17:30:08.200593 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-mkzvg\" is waiting to start: ContainerCreating" I0420 17:30:08.200601 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-mkzvg pod in namespace openshift-dns (previous: false). I0420 17:30:08.400874 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mkzvg pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-mkzvg\" is waiting to start: ContainerCreating" I0420 17:30:08.400889 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-mkzvg\" is waiting to start: ContainerCreating" I0420 17:30:08.400900 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-r42ks pod in namespace openshift-dns (previous: false). I0420 17:30:08.628881 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0420 17:30:08.681948 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-r42ks pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-r42ks\" is waiting to start: ContainerCreating" I0420 17:30:08.681961 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-r42ks\" is waiting to start: ContainerCreating" I0420 17:30:08.681969 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-r42ks pod in namespace openshift-dns (previous: false). I0420 17:30:08.810767 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-r42ks pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-r42ks\" is waiting to start: ContainerCreating" I0420 17:30:08.810780 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-r42ks\" is waiting to start: ContainerCreating" I0420 17:30:08.810788 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9xfvk pod in namespace openshift-dns (previous: false). I0420 17:30:09.005679 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 17:30:09.005698 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-l994d pod in namespace openshift-dns (previous: false). I0420 17:30:09.028358 1 tasks_processing.go:74] worker 50 stopped. I0420 17:30:09.028426 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=f29cc4aee9248641906c31437ef9d0a951ce4029dfece47bcca71507468cd294 I0420 17:30:09.028473 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=2e50496eeaa9cb65454fdcd95f827f3be5be7bc0a968761f51284163b38c5337 I0420 17:30:09.028507 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0420 17:30:09.028533 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=682b629a0c71bb53017bb1f5c4408578c06b8d910190d7913b2367a014716e30 I0420 17:30:09.028550 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0420 17:30:09.028575 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=991918c0fe41e30b38eef8ad971e861de225eacabf0d48f70618d837884f0c82 I0420 17:30:09.028627 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=9310a0d32600fd520126f70b3c73743cf21ff4a0e1c7a8eb6665bdf7ea6c1365 I0420 17:30:09.028677 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=493d61577cc2038b1b33e735a8f0e1380768db5abae694ec21682af05415f602 I0420 17:30:09.028695 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=aae8c7de13858fe537b2dee88f183891024566909b8afa5b73e063adc71a7f0a I0420 17:30:09.028712 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=11d22abe9b1b2f500f5e5c47cca421abc3ac62afc4db8736bae85fd60b77973d I0420 17:30:09.028723 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0420 17:30:09.028739 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=cc2f1c8bd19fed3fe2a71b972c12af7947b3bac4ddff0c4cb94a6f777478413f I0420 17:30:09.028750 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0420 17:30:09.028766 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=5fa017b1e9b55cdc21760a06529ebddcafe14a81774119e1acab1b7810420ec5 I0420 17:30:09.028777 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0420 17:30:09.028789 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=124f93c2a037a951d10a1a12c45ada4c0a21cde5f69f5ad485336a47822c06eb I0420 17:30:09.028797 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0420 17:30:09.028813 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=959b30585c8a192f42fbc274f4f67567386db6dce3151d9ff2ce6c4dd1575bfc I0420 17:30:09.028936 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=d676c1af3eb97d652e2ad8bbd815e6884c6b99846c9a2c6b0f17a24bbc03e384 I0420 17:30:09.028947 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0420 17:30:09.028954 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0420 17:30:09.028975 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0420 17:30:09.028999 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=0a09149494e848d93d8a3628e5322fa798d48c546071613c8bb938b6815be81b I0420 17:30:09.029022 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=8db864ebf88a1fb41b432c508c948eb57b05c0734d20533caed74acbba931a30 I0420 17:30:09.029033 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0420 17:30:09.029048 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=c57e914e0c5485e47798b3a5746bef311a01680773ec8f2c3a65402348aeead1 I0420 17:30:09.029055 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0420 17:30:09.029068 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=7a19d551694d34a8cbfb631db287f9f11af76da256beec399054ac1302d312a8 I0420 17:30:09.029080 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=74b37a0e7540f28c3f0ac09c94c23981a65cbd228a36245863c8ca2190889141 I0420 17:30:09.029095 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=98c80c051f990d88f48e411e52ce5783ed768e47d4a7cdb287f21dd29dced93f I0420 17:30:09.029109 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=34ee702fab59005a0c04defda8347c064d012cccc41654a0e878f6b153c66f8e I0420 17:30:09.029124 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=113e51efd0fae8105c2b08481632f5d2497b3f2957c2301fce1ec329c949b7b7 I0420 17:30:09.029147 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=93064f77b7d58beebffdd5de54e743c6c4f5cdbfb9f1f23db15a81110576a493 I0420 17:30:09.029162 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0420 17:30:09.029169 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0420 17:30:09.029176 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.875374294s to process 35 records W0420 17:30:09.180719 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 17:30:09.202016 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 17:30:09.202062 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ppw6x pod in namespace openshift-dns (previous: false). I0420 17:30:09.401329 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 17:30:09.401345 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7b8f75b565-8hbhp pod in namespace openshift-image-registry (previous: false). I0420 17:30:09.616893 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7b8f75b565-8hbhp pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7b8f75b565-8hbhp\" is waiting to start: ContainerCreating" I0420 17:30:09.616911 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7b8f75b565-8hbhp\" is waiting to start: ContainerCreating" I0420 17:30:09.616923 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7b8f75b565-fkk9v pod in namespace openshift-image-registry (previous: false). I0420 17:30:09.803699 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7b8f75b565-fkk9v pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7b8f75b565-fkk9v\" is waiting to start: ContainerCreating" I0420 17:30:09.803715 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7b8f75b565-fkk9v\" is waiting to start: ContainerCreating" I0420 17:30:09.803723 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7ffb45df4b-smxqc pod in namespace openshift-image-registry (previous: false). I0420 17:30:10.000972 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7ffb45df4b-smxqc pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7ffb45df4b-smxqc\" is waiting to start: ContainerCreating" I0420 17:30:10.000988 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7ffb45df4b-smxqc\" is waiting to start: ContainerCreating" I0420 17:30:10.000998 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-d4ntn pod in namespace openshift-image-registry (previous: false). W0420 17:30:10.181291 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 17:30:10.201411 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 17:30:10.201426 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-ddhjs pod in namespace openshift-image-registry (previous: false). I0420 17:30:10.401564 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 17:30:10.401579 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-jm9dr pod in namespace openshift-image-registry (previous: false). I0420 17:30:10.604517 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 17:30:10.604532 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5c46567b58-8sgjk pod in namespace openshift-ingress (previous: false). I0420 17:30:10.801712 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5c46567b58-8sgjk pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5c46567b58-8sgjk\" is waiting to start: ContainerCreating" I0420 17:30:10.801727 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5c46567b58-8sgjk\" is waiting to start: ContainerCreating" I0420 17:30:10.801741 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5c46567b58-qjgsj pod in namespace openshift-ingress (previous: false). I0420 17:30:11.001692 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5c46567b58-qjgsj pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5c46567b58-qjgsj\" is waiting to start: ContainerCreating" I0420 17:30:11.001709 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5c46567b58-qjgsj\" is waiting to start: ContainerCreating" I0420 17:30:11.001724 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-78dc8f788c-xt6g4 pod in namespace openshift-ingress (previous: false). W0420 17:30:11.182210 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 17:30:11.203037 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-78dc8f788c-xt6g4 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-78dc8f788c-xt6g4\" is waiting to start: ContainerCreating" I0420 17:30:11.203053 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-78dc8f788c-xt6g4\" is waiting to start: ContainerCreating" I0420 17:30:11.203062 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5sn4g pod in namespace openshift-ingress-canary (previous: false). I0420 17:30:11.405525 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5zwsv pod in namespace openshift-ingress-canary (previous: false). I0420 17:30:11.601289 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-fxjdv pod in namespace openshift-ingress-canary (previous: false). I0420 17:30:11.801494 1 tasks_processing.go:74] worker 61 stopped. I0420 17:30:11.801606 1 recorder.go:75] Recording events/openshift-dns with fingerprint=ea70d1f1994a6576c016ddea7737469a7ac597fdfe8c6424d2c7c0565889328d I0420 17:30:11.801727 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=fe08bb4e6118a12b97d044872f42d3e3c02f898a045f1fbbdbb09ebea549914b I0420 17:30:11.801758 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=1910426fe5e852da295be988f697abda6104f52271fa34ba13eaf34040c72dd7 I0420 17:30:11.801807 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=c1638d929773f62b72562d88d4f67305eb7ac6758e3836bb7360bf7d28fe73f3 I0420 17:30:11.801844 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=f31ba559c0bca1e674a789a9c0508bb65792f40a62d8465da01f8ca345706b57 I0420 17:30:11.801854 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-5sn4g/serve-healthcheck-canary_current.log with fingerprint=ba2ebd7bd07ed7ed8437133c7edc7921c40809f374c8b380dada617a3a7cb4ab I0420 17:30:11.801859 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-5zwsv/serve-healthcheck-canary_current.log with fingerprint=1ab09ad8e009821220c1c9c3f434e6df83bf5167ff57e81008196918c0d18b16 I0420 17:30:11.801865 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-fxjdv/serve-healthcheck-canary_current.log with fingerprint=70db22084cb7d1fc732a2c96ca603224aa47de8d1405ed9253bd10a9d801a56b I0420 17:30:11.801872 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.648165611s to process 8 records W0420 17:30:12.181532 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0420 17:30:12.181557 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0420 17:30:12.181573 1 tasks_processing.go:74] worker 56 stopped. E0420 17:30:12.181585 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0420 17:30:12.181597 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0420 17:30:12.181613 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0420 17:30:12.181625 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.028960261s to process 1 records I0420 17:30:19.587239 1 tasks_processing.go:74] worker 52 stopped. I0420 17:30:19.587274 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0420 17:30:19.587286 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.435026342s to process 1 records I0420 17:30:20.361353 1 tasks_processing.go:74] worker 49 stopped. I0420 17:30:20.361674 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=7c1a3e3c431de69ce4ee6fb33aad2158a3d38446a91ec5899ca71ceaf725097e I0420 17:30:20.361694 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.208227963s to process 1 records E0420 17:30:20.361768 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.209s with: function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0420 17:30:20.362884 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0420 17:30:20.362904 1 periodic.go:216] Running workloads gatherer I0420 17:30:20.362922 1 tasks_processing.go:45] number of workers: 2 I0420 17:30:20.362935 1 tasks_processing.go:69] worker 1 listening for tasks. I0420 17:30:20.362940 1 tasks_processing.go:71] worker 1 working on workload_info task. I0420 17:30:20.362954 1 tasks_processing.go:69] worker 0 listening for tasks. I0420 17:30:20.362972 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0420 17:30:20.392168 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0420 17:30:20.404508 1 tasks_processing.go:74] worker 0 stopped. I0420 17:30:20.404532 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 41.522278ms to process 0 records I0420 17:30:20.405570 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (14ms) I0420 17:30:20.418509 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (13ms) I0420 17:30:20.428756 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (10ms) I0420 17:30:20.440683 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (12ms) I0420 17:30:20.451187 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (10ms) I0420 17:30:20.461582 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (10ms) I0420 17:30:20.472025 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (10ms) I0420 17:30:20.483610 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (12ms) I0420 17:30:20.498668 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (15ms) I0420 17:30:20.509988 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (11ms) I0420 17:30:20.521563 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (12ms) I0420 17:30:20.606158 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (85ms) I0420 17:30:20.704044 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (98ms) I0420 17:30:20.804244 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (100ms) I0420 17:30:20.903752 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (99ms) I0420 17:30:21.006989 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (103ms) I0420 17:30:21.103952 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (97ms) I0420 17:30:21.205308 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (101ms) I0420 17:30:21.302749 1 gather_workloads_info.go:387] No image sha256:4b748615a43be416d52c33df03e2cdec89ededded1d6a2ade167c5a955d56e5f (97ms) I0420 17:30:21.404396 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (102ms) I0420 17:30:21.502927 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (99ms) I0420 17:30:21.604900 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (102ms) I0420 17:30:21.704533 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0420 17:30:21.809042 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (104ms) I0420 17:30:21.903632 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (95ms) I0420 17:30:22.004502 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (101ms) I0420 17:30:22.103804 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (99ms) I0420 17:30:22.206519 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (103ms) I0420 17:30:22.304106 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (98ms) I0420 17:30:22.327612 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 17:30:22.409686 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (106ms) I0420 17:30:22.503273 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (94ms) I0420 17:30:22.605569 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (102ms) I0420 17:30:22.609311 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 17:30:22.702472 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (97ms) I0420 17:30:22.815821 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (113ms) I0420 17:30:22.815853 1 tasks_processing.go:74] worker 1 stopped. E0420 17:30:22.815864 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0420 17:30:22.816129 1 recorder.go:75] Recording config/workload_info with fingerprint=3001b8aee2eb07979ecb91c2784bc81e18c98901448429aa6b2963cae2782c55 I0420 17:30:22.816133 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 17:30:22.816147 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.452906243s to process 1 records E0420 17:30:22.816174 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.453s with: function \"workload_info\" failed with an error" I0420 17:30:22.817287 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0420 17:30:22.817303 1 periodic.go:216] Running conditional gatherer I0420 17:30:22.824913 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0420 17:30:22.832173 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.16:49290->172.30.0.10:53: read: connection refused E0420 17:30:22.832432 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 17:30:22.832783 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0420 17:30:22.842214 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0420 17:30:22.842229 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 17:30:22.842235 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 17:30:22.842238 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 17:30:22.842242 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 17:30:22.842245 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 17:30:22.842248 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 17:30:22.842251 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 17:30:22.842254 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 17:30:22.842257 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0420 17:30:22.842276 1 tasks_processing.go:45] number of workers: 3 I0420 17:30:22.842286 1 tasks_processing.go:69] worker 2 listening for tasks. I0420 17:30:22.842291 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0420 17:30:22.842303 1 tasks_processing.go:69] worker 0 listening for tasks. I0420 17:30:22.842314 1 tasks_processing.go:69] worker 1 listening for tasks. I0420 17:30:22.842325 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0420 17:30:22.842326 1 tasks_processing.go:74] worker 1 stopped. I0420 17:30:22.842343 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0420 17:30:22.842405 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0420 17:30:22.842424 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 924ns to process 1 records I0420 17:30:22.842471 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0420 17:30:22.842482 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.642µs to process 1 records I0420 17:30:22.842491 1 tasks_processing.go:74] worker 0 stopped. I0420 17:30:22.842658 1 tasks_processing.go:74] worker 2 stopped. I0420 17:30:22.842670 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 287.168µs to process 0 records I0420 17:30:22.842689 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.16:49290->172.30.0.10:53: read: connection refused I0420 17:30:22.842706 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0420 17:30:22.869074 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=daecdae867658baa39ac1d6cc72bb1ffc53cd8440b0ff01aa05b0dd9e1532d56 I0420 17:30:22.869199 1 diskrecorder.go:70] Writing 101 records to /var/lib/insights-operator/insights-2026-04-20-173022.tar.gz I0420 17:30:22.875041 1 diskrecorder.go:51] Wrote 101 records to disk in 5ms I0420 17:30:22.875071 1 periodic.go:285] Gathering cluster info every 2h0m0s I0420 17:30:22.875085 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0420 17:30:32.427116 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 17:31:26.598954 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="e28e4310cc49ecad0575258c96a5b2a4c8bd4c972a947dd3fe8ebdc201a45557") W0420 17:31:26.598991 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0420 17:31:26.599044 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="948418102c7006a03331e918d1376043eea6074a44b1c1bfcbf1722ff8e2b008") I0420 17:31:26.599075 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0420 17:31:26.599103 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0420 17:31:26.599104 1 base_controller.go:181] Shutting down ConfigController ... I0420 17:31:26.599110 1 base_controller.go:181] Shutting down LoggingSyncer ... I0420 17:31:26.599120 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0420 17:31:26.599128 1 base_controller.go:113] All ConfigController workers have been terminated I0420 17:31:26.599143 1 periodic.go:177] Shutting down I0420 17:31:26.599147 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0420 17:31:26.599155 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0420 17:31:26.599161 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0420 17:31:26.599162 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0420 17:31:26.599086 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="d6b9af0f1e05eb59ff5b2f43b029269c3110fc5b714c7ef532dd2c401c4b2583") I0420 17:31:26.599171 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0420 17:31:26.599184 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0420 17:31:26.599193 1 secure_serving.go:258] Stopped listening on [::]:8443 I0420 17:31:26.599204 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I0420 17:31:26.599218 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-173811080/tls.crt::/tmp/serving-cert-173811080/tls.key" I0420 17:31:26.599266 1 genericapiserver.go:600] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening"