W0506 03:07:15.086534 1 cmd.go:257] Using insecure, self-signed certificates I0506 03:07:15.881882 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 03:07:15.882188 1 observer_polling.go:159] Starting file observer I0506 03:07:16.579454 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0506 03:07:16.579695 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0506 03:07:16.580244 1 secure_serving.go:57] Forcing use of http/1.1 only W0506 03:07:16.580264 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0506 03:07:16.580270 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0506 03:07:16.580273 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0506 03:07:16.580276 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0506 03:07:16.580278 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0506 03:07:16.580281 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0506 03:07:16.580727 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0506 03:07:16.584177 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0506 03:07:16.584220 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"73931f3f-41e8-4601-8bfe-59a789c4ee58", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0506 03:07:16.584579 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0506 03:07:16.584598 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0506 03:07:16.584601 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0506 03:07:16.584646 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0506 03:07:16.584633 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0506 03:07:16.584662 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0506 03:07:16.584883 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3181843861/tls.crt::/tmp/serving-cert-3181843861/tls.key" I0506 03:07:16.585189 1 secure_serving.go:213] Serving securely on [::]:8443 I0506 03:07:16.585216 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0506 03:07:16.589621 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0506 03:07:16.589639 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0506 03:07:16.589845 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0506 03:07:16.599061 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:07:16.599079 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0506 03:07:16.606128 1 secretconfigobserver.go:119] support secret does not exist I0506 03:07:16.611484 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:07:16.615082 1 secretconfigobserver.go:119] support secret does not exist I0506 03:07:16.616812 1 recorder.go:176] Pruning old reports every 5h16m14s, max age is 288h0m0s I0506 03:07:16.621382 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0506 03:07:16.621404 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0506 03:07:16.621405 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0506 03:07:16.621387 1 periodic.go:216] Running clusterconfig gatherer I0506 03:07:16.621416 1 insightsreport.go:296] Starting report retriever I0506 03:07:16.621425 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0506 03:07:16.621451 1 tasks_processing.go:45] number of workers: 64 I0506 03:07:16.621489 1 tasks_processing.go:69] worker 63 listening for tasks. I0506 03:07:16.621495 1 tasks_processing.go:71] worker 63 working on oauths task. I0506 03:07:16.621531 1 tasks_processing.go:69] worker 31 listening for tasks. I0506 03:07:16.621544 1 tasks_processing.go:69] worker 16 listening for tasks. I0506 03:07:16.621544 1 tasks_processing.go:69] worker 15 listening for tasks. I0506 03:07:16.621552 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 03:07:16.621554 1 tasks_processing.go:69] worker 17 listening for tasks. I0506 03:07:16.621558 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 03:07:16.621556 1 tasks_processing.go:69] worker 47 listening for tasks. I0506 03:07:16.621562 1 tasks_processing.go:69] worker 18 listening for tasks. I0506 03:07:16.621571 1 tasks_processing.go:69] worker 19 listening for tasks. I0506 03:07:16.621564 1 tasks_processing.go:69] worker 9 listening for tasks. I0506 03:07:16.621581 1 tasks_processing.go:69] worker 32 listening for tasks. I0506 03:07:16.621568 1 tasks_processing.go:69] worker 10 listening for tasks. I0506 03:07:16.621585 1 tasks_processing.go:69] worker 5 listening for tasks. I0506 03:07:16.621578 1 tasks_processing.go:69] worker 12 listening for tasks. I0506 03:07:16.621594 1 tasks_processing.go:69] worker 33 listening for tasks. I0506 03:07:16.621594 1 tasks_processing.go:69] worker 7 listening for tasks. I0506 03:07:16.621597 1 tasks_processing.go:69] worker 21 listening for tasks. I0506 03:07:16.621573 1 tasks_processing.go:69] worker 8 listening for tasks. I0506 03:07:16.621603 1 tasks_processing.go:69] worker 34 listening for tasks. I0506 03:07:16.621582 1 tasks_processing.go:69] worker 13 listening for tasks. I0506 03:07:16.621607 1 tasks_processing.go:69] worker 48 listening for tasks. I0506 03:07:16.621573 1 tasks_processing.go:69] worker 11 listening for tasks. I0506 03:07:16.621587 1 tasks_processing.go:69] worker 14 listening for tasks. I0506 03:07:16.621611 1 tasks_processing.go:69] worker 3 listening for tasks. I0506 03:07:16.621615 1 tasks_processing.go:69] worker 27 listening for tasks. I0506 03:07:16.621620 1 tasks_processing.go:69] worker 36 listening for tasks. I0506 03:07:16.621590 1 tasks_processing.go:69] worker 4 listening for tasks. I0506 03:07:16.621625 1 tasks_processing.go:69] worker 52 listening for tasks. I0506 03:07:16.621627 1 tasks_processing.go:69] worker 23 listening for tasks. I0506 03:07:16.621630 1 tasks_processing.go:69] worker 54 listening for tasks. I0506 03:07:16.621603 1 tasks_processing.go:69] worker 2 listening for tasks. I0506 03:07:16.621606 1 tasks_processing.go:69] worker 22 listening for tasks. I0506 03:07:16.621637 1 tasks_processing.go:69] worker 57 listening for tasks. I0506 03:07:16.621639 1 tasks_processing.go:69] worker 58 listening for tasks. I0506 03:07:16.621643 1 tasks_processing.go:69] worker 42 listening for tasks. I0506 03:07:16.621638 1 tasks_processing.go:69] worker 25 listening for tasks. I0506 03:07:16.621646 1 tasks_processing.go:69] worker 60 listening for tasks. I0506 03:07:16.621648 1 tasks_processing.go:69] worker 43 listening for tasks. I0506 03:07:16.621651 1 tasks_processing.go:69] worker 46 listening for tasks. I0506 03:07:16.621649 1 tasks_processing.go:69] worker 29 listening for tasks. I0506 03:07:16.621655 1 tasks_processing.go:69] worker 44 listening for tasks. I0506 03:07:16.621659 1 tasks_processing.go:71] worker 15 working on crds task. I0506 03:07:16.621659 1 tasks_processing.go:71] worker 31 working on openstack_dataplanedeployments task. I0506 03:07:16.621662 1 tasks_processing.go:71] worker 18 working on machines task. I0506 03:07:16.621662 1 tasks_processing.go:71] worker 17 working on nodes task. I0506 03:07:16.621667 1 tasks_processing.go:71] worker 47 working on machine_healthchecks task. I0506 03:07:16.621667 1 tasks_processing.go:71] worker 0 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0506 03:07:16.621662 1 tasks_processing.go:69] worker 45 listening for tasks. I0506 03:07:16.621667 1 tasks_processing.go:71] worker 1 working on config_maps task. I0506 03:07:16.621696 1 tasks_processing.go:71] worker 5 working on ingress task. I0506 03:07:16.621698 1 tasks_processing.go:71] worker 45 working on active_alerts task. I0506 03:07:16.621705 1 tasks_processing.go:71] worker 8 working on proxies task. I0506 03:07:16.621704 1 tasks_processing.go:71] worker 10 working on lokistack task. I0506 03:07:16.621726 1 tasks_processing.go:71] worker 42 working on node_features task. I0506 03:07:16.621724 1 tasks_processing.go:71] worker 12 working on certificate_signing_requests task. I0506 03:07:16.621731 1 tasks_processing.go:71] worker 23 working on overlapping_namespace_uids task. I0506 03:07:16.621701 1 tasks_processing.go:71] worker 21 working on openshift_machine_api_events task. I0506 03:07:16.621740 1 tasks_processing.go:71] worker 32 working on machine_configs task. I0506 03:07:16.621607 1 tasks_processing.go:69] worker 6 listening for tasks. I0506 03:07:16.621589 1 tasks_processing.go:69] worker 20 listening for tasks. I0506 03:07:16.621621 1 tasks_processing.go:69] worker 59 listening for tasks. I0506 03:07:16.621621 1 tasks_processing.go:69] worker 50 listening for tasks. I0506 03:07:16.621621 1 tasks_processing.go:69] worker 24 listening for tasks. I0506 03:07:16.621602 1 tasks_processing.go:69] worker 55 listening for tasks. I0506 03:07:16.621625 1 tasks_processing.go:69] worker 53 listening for tasks. I0506 03:07:16.621628 1 tasks_processing.go:69] worker 28 listening for tasks. I0506 03:07:16.621627 1 tasks_processing.go:69] worker 56 listening for tasks. I0506 03:07:16.621626 1 tasks_processing.go:69] worker 26 listening for tasks. I0506 03:07:16.621632 1 tasks_processing.go:69] worker 37 listening for tasks. I0506 03:07:16.621636 1 tasks_processing.go:69] worker 51 listening for tasks. I0506 03:07:16.621635 1 tasks_processing.go:69] worker 30 listening for tasks. I0506 03:07:16.621638 1 tasks_processing.go:69] worker 38 listening for tasks. I0506 03:07:16.621613 1 tasks_processing.go:69] worker 35 listening for tasks. I0506 03:07:16.621645 1 tasks_processing.go:69] worker 61 listening for tasks. I0506 03:07:16.621690 1 tasks_processing.go:71] worker 44 working on machine_autoscalers task. I0506 03:07:16.621823 1 tasks_processing.go:71] worker 43 working on openshift_logging task. I0506 03:07:16.621840 1 tasks_processing.go:71] worker 25 working on feature_gates task. I0506 03:07:16.621648 1 tasks_processing.go:69] worker 40 listening for tasks. I0506 03:07:16.621650 1 tasks_processing.go:69] worker 41 listening for tasks. I0506 03:07:16.621654 1 tasks_processing.go:69] worker 39 listening for tasks. I0506 03:07:16.621656 1 tasks_processing.go:69] worker 62 listening for tasks. I0506 03:07:16.621660 1 tasks_processing.go:71] worker 16 working on storage_classes task. I0506 03:07:16.621911 1 tasks_processing.go:71] worker 29 working on sap_pods task. I0506 03:07:16.621947 1 tasks_processing.go:71] worker 22 working on aggregated_monitoring_cr_names task. I0506 03:07:16.621957 1 tasks_processing.go:71] worker 27 working on sap_datahubs task. I0506 03:07:16.621955 1 tasks_processing.go:71] worker 58 working on sap_config task. I0506 03:07:16.621972 1 tasks_processing.go:71] worker 52 working on tsdb_status task. W0506 03:07:16.621733 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0506 03:07:16.621994 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 03:07:16.621915 1 tasks_processing.go:71] worker 60 working on clusterroles task. I0506 03:07:16.622006 1 tasks_processing.go:71] worker 2 working on nodenetworkstates task. I0506 03:07:16.621666 1 tasks_processing.go:71] worker 33 working on service_accounts task. I0506 03:07:16.621825 1 tasks_processing.go:71] worker 46 working on machine_config_pools task. I0506 03:07:16.622150 1 tasks_processing.go:71] worker 36 working on storage_cluster task. I0506 03:07:16.622162 1 tasks_processing.go:71] worker 28 working on node_logs task. I0506 03:07:16.621687 1 tasks_processing.go:71] worker 19 working on container_images task. I0506 03:07:16.622232 1 tasks_processing.go:71] worker 38 working on ceph_cluster task. I0506 03:07:16.622263 1 tasks_processing.go:71] worker 40 working on openstack_version task. I0506 03:07:16.622268 1 tasks_processing.go:71] worker 37 working on jaegers task. I0506 03:07:16.622294 1 tasks_processing.go:71] worker 35 working on metrics task. I0506 03:07:16.622301 1 tasks_processing.go:71] worker 51 working on pod_network_connectivity_checks task. W0506 03:07:16.622313 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 03:07:16.622320 1 tasks_processing.go:71] worker 61 working on machine_sets task. I0506 03:07:16.622324 1 tasks_processing.go:71] worker 30 working on version task. I0506 03:07:16.622401 1 tasks_processing.go:71] worker 39 working on openstack_controlplanes task. I0506 03:07:16.621928 1 tasks_processing.go:71] worker 3 working on mutating_webhook_configurations task. I0506 03:07:16.622443 1 tasks_processing.go:71] worker 62 working on container_runtime_configs task. I0506 03:07:16.622459 1 tasks_processing.go:71] worker 41 working on validating_webhook_configurations task. I0506 03:07:16.621932 1 tasks_processing.go:71] worker 34 working on image_pruners task. I0506 03:07:16.621939 1 tasks_processing.go:71] worker 48 working on ingress_certificates task. I0506 03:07:16.622803 1 tasks_processing.go:71] worker 56 working on authentication task. I0506 03:07:16.622811 1 tasks_processing.go:71] worker 26 working on dvo_metrics task. I0506 03:07:16.621692 1 tasks_processing.go:71] worker 9 working on operators task. I0506 03:07:16.621696 1 tasks_processing.go:71] worker 7 working on openstack_dataplanenodesets task. I0506 03:07:16.621942 1 tasks_processing.go:71] worker 11 working on support_secret task. I0506 03:07:16.621946 1 tasks_processing.go:71] worker 14 working on nodenetworkconfigurationpolicies task. I0506 03:07:16.621997 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 280.712µs to process 0 records I0506 03:07:16.623114 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 27.375µs to process 0 records I0506 03:07:16.621616 1 tasks_processing.go:69] worker 49 listening for tasks. I0506 03:07:16.623126 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 22.594µs to process 0 records I0506 03:07:16.623130 1 tasks_processing.go:71] worker 49 working on cluster_apiserver task. I0506 03:07:16.622132 1 tasks_processing.go:71] worker 45 working on install_plans task. I0506 03:07:16.621950 1 tasks_processing.go:71] worker 57 working on monitoring_persistent_volumes task. I0506 03:07:16.621953 1 tasks_processing.go:71] worker 4 working on cost_management_metrics_configs task. I0506 03:07:16.622138 1 tasks_processing.go:71] worker 6 working on image task. I0506 03:07:16.622142 1 tasks_processing.go:71] worker 20 working on silenced_alerts task. I0506 03:07:16.622145 1 tasks_processing.go:71] worker 59 working on operators_pods_and_events task. W0506 03:07:16.623318 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 03:07:16.623328 1 tasks_processing.go:74] worker 20 stopped. I0506 03:07:16.622151 1 tasks_processing.go:71] worker 24 working on qemu_kubevirt_launcher_logs task. I0506 03:07:16.622148 1 tasks_processing.go:71] worker 50 working on infrastructures task. I0506 03:07:16.622156 1 tasks_processing.go:71] worker 55 working on image_registries task. I0506 03:07:16.622159 1 tasks_processing.go:71] worker 53 working on schedulers task. I0506 03:07:16.623221 1 tasks_processing.go:74] worker 52 stopped. I0506 03:07:16.623339 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 25.116µs to process 0 records I0506 03:07:16.621936 1 tasks_processing.go:71] worker 13 working on networks task. I0506 03:07:16.623430 1 tasks_processing.go:71] worker 35 working on olm_operators task. I0506 03:07:16.621945 1 tasks_processing.go:71] worker 54 working on pdbs task. I0506 03:07:16.631634 1 tasks_processing.go:74] worker 10 stopped. I0506 03:07:16.631646 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 9.910673ms to process 0 records I0506 03:07:16.631766 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0506 03:07:16.631783 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0506 03:07:16.631787 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0506 03:07:16.631790 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0506 03:07:16.631803 1 controller.go:531] The operator is still being initialized I0506 03:07:16.631811 1 controller.go:554] The operator is healthy I0506 03:07:16.639594 1 tasks_processing.go:74] worker 43 stopped. I0506 03:07:16.639612 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 17.746332ms to process 0 records I0506 03:07:16.639660 1 tasks_processing.go:74] worker 18 stopped. E0506 03:07:16.639688 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0506 03:07:16.639699 1 gather.go:177] gatherer "clusterconfig" function "machines" took 17.985866ms to process 0 records I0506 03:07:16.639812 1 tasks_processing.go:74] worker 63 stopped. I0506 03:07:16.640043 1 recorder.go:75] Recording config/oauth with fingerprint=6d44b1d2cb7e904e555807d4291268950430239d8948bbe24a78efb600d78b62 I0506 03:07:16.640058 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 18.305716ms to process 1 records I0506 03:07:16.647200 1 tasks_processing.go:74] worker 47 stopped. E0506 03:07:16.647211 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0506 03:07:16.647219 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 25.526096ms to process 0 records I0506 03:07:16.647226 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 25.236306ms to process 0 records I0506 03:07:16.647232 1 tasks_processing.go:74] worker 27 stopped. E0506 03:07:16.647256 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0506 03:07:16.647264 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 25.594305ms to process 0 records I0506 03:07:16.647260 1 tasks_processing.go:74] worker 31 stopped. I0506 03:07:16.647269 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 25.53575ms to process 0 records I0506 03:07:16.647273 1 tasks_processing.go:74] worker 42 stopped. I0506 03:07:16.647579 1 tasks_processing.go:74] worker 8 stopped. I0506 03:07:16.647917 1 recorder.go:75] Recording config/proxy with fingerprint=e02a470ad3c5d1395123680c3adfae1f2a10c97bf96ce55b14f38a75391ab208 I0506 03:07:16.647939 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 25.86488ms to process 1 records I0506 03:07:16.647950 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 25.43473ms to process 0 records I0506 03:07:16.647964 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 25.408152ms to process 0 records I0506 03:07:16.647971 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 25.426968ms to process 0 records I0506 03:07:16.647977 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 25.815492ms to process 0 records I0506 03:07:16.647987 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 25.815878ms to process 0 records I0506 03:07:16.647993 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 26.102258ms to process 0 records I0506 03:07:16.648005 1 tasks_processing.go:74] worker 21 stopped. I0506 03:07:16.648008 1 tasks_processing.go:74] worker 61 stopped. I0506 03:07:16.648016 1 tasks_processing.go:74] worker 2 stopped. I0506 03:07:16.648012 1 tasks_processing.go:74] worker 29 stopped. I0506 03:07:16.648030 1 tasks_processing.go:74] worker 38 stopped. I0506 03:07:16.648031 1 tasks_processing.go:74] worker 36 stopped. I0506 03:07:16.648218 1 tasks_processing.go:74] worker 5 stopped. I0506 03:07:16.648560 1 recorder.go:75] Recording config/ingress with fingerprint=bf42bb9b785607d992bb23f0e72fe2b9ce60fca7e2905a2505667580e1a5930b I0506 03:07:16.648628 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 26.511404ms to process 1 records I0506 03:07:16.649521 1 tasks_processing.go:74] worker 58 stopped. I0506 03:07:16.649538 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 27.54829ms to process 0 records I0506 03:07:16.649732 1 tasks_processing.go:74] worker 62 stopped. I0506 03:07:16.649742 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 27.281435ms to process 0 records I0506 03:07:16.649778 1 tasks_processing.go:74] worker 44 stopped. I0506 03:07:16.649789 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 27.958058ms to process 0 records I0506 03:07:16.649906 1 tasks_processing.go:74] worker 34 stopped. I0506 03:07:16.650049 1 gather_logs.go:145] no pods in namespace were found I0506 03:07:16.650205 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=b8e15e56d4024fe3a5217a1a29e373cad3e033981f7a2ff9a7a4ae48726c6d83 I0506 03:07:16.650225 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 27.372379ms to process 1 records I0506 03:07:16.650237 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 27.639902ms to process 0 records I0506 03:07:16.650243 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 26.847898ms to process 0 records I0506 03:07:16.650248 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 27.546053ms to process 0 records I0506 03:07:16.650254 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 26.794235ms to process 0 records I0506 03:07:16.650259 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 27.817656ms to process 0 records I0506 03:07:16.650264 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 27.088491ms to process 0 records I0506 03:07:16.650269 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 27.857671ms to process 0 records E0506 03:07:16.650277 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0506 03:07:16.650285 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 27.089498ms to process 0 records I0506 03:07:16.650294 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 26.713954ms to process 0 records I0506 03:07:16.650329 1 tasks_processing.go:74] worker 28 stopped. I0506 03:07:16.650333 1 tasks_processing.go:74] worker 46 stopped. I0506 03:07:16.650338 1 tasks_processing.go:74] worker 7 stopped. I0506 03:07:16.650344 1 tasks_processing.go:74] worker 37 stopped. I0506 03:07:16.650346 1 tasks_processing.go:74] worker 39 stopped. I0506 03:07:16.650349 1 tasks_processing.go:74] worker 4 stopped. I0506 03:07:16.650350 1 tasks_processing.go:74] worker 14 stopped. I0506 03:07:16.650350 1 tasks_processing.go:74] worker 11 stopped. I0506 03:07:16.650355 1 tasks_processing.go:74] worker 24 stopped. I0506 03:07:16.650379 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=5d2de29a2954236eb93900fe14ccd8c91eb04204da8999b6fc08fe91654fb496 I0506 03:07:16.650395 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=f97082bff514899ab1b195f34815b63b1f62fe291fe91f551a76aba0fdc4fa17 I0506 03:07:16.650400 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 28.239488ms to process 2 records I0506 03:07:16.650421 1 tasks_processing.go:74] worker 16 stopped. I0506 03:07:16.650467 1 recorder.go:75] Recording config/image with fingerprint=4c0357ae5d24b1d80c89b9fac883ad8b6bf361a7cff06a79f714126ca39140f5 I0506 03:07:16.650477 1 gather.go:177] gatherer "clusterconfig" function "image" took 26.93225ms to process 1 records I0506 03:07:16.650482 1 tasks_processing.go:74] worker 6 stopped. I0506 03:07:16.650549 1 tasks_processing.go:74] worker 56 stopped. I0506 03:07:16.650624 1 recorder.go:75] Recording config/authentication with fingerprint=e9e6b0846c89d624f19e706a91eccfdadfc94bab821451b60a2b1d63ba2b0f5b I0506 03:07:16.650633 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 27.580448ms to process 1 records I0506 03:07:16.650710 1 tasks_processing.go:74] worker 51 stopped. E0506 03:07:16.650725 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0506 03:07:16.650735 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 28.398349ms to process 0 records I0506 03:07:16.650849 1 tasks_processing.go:74] worker 49 stopped. I0506 03:07:16.650980 1 recorder.go:75] Recording config/apiserver with fingerprint=151205c4d72e583f2bdc511967b56b56cd8cebebe9c8e6d0b31ec39586cdffb5 I0506 03:07:16.650995 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 27.705479ms to process 1 records I0506 03:07:16.651118 1 tasks_processing.go:74] worker 50 stopped. I0506 03:07:16.651455 1 recorder.go:75] Recording config/infrastructure with fingerprint=0734295be8f59b991f0792e990d9a1b4909ceb43772c4fec6555c1f90f8fd37b I0506 03:07:16.651467 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 27.513547ms to process 1 records I0506 03:07:16.651545 1 recorder.go:75] Recording config/featuregate with fingerprint=febba5ae3131f82d20130d7919df4e9e5ee210cd05db1a2134480ac1cbff158e I0506 03:07:16.651553 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 29.027645ms to process 1 records I0506 03:07:16.651593 1 tasks_processing.go:74] worker 25 stopped. I0506 03:07:16.651658 1 recorder.go:75] Recording config/network with fingerprint=40885b303bb9cfddb2c4b1e822807747d0027e604b012b768ad3d1fd5045d219 I0506 03:07:16.651668 1 tasks_processing.go:74] worker 13 stopped. I0506 03:07:16.651689 1 gather.go:177] gatherer "clusterconfig" function "networks" took 27.525772ms to process 1 records I0506 03:07:16.651762 1 tasks_processing.go:74] worker 40 stopped. I0506 03:07:16.651774 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 29.489488ms to process 0 records I0506 03:07:16.652586 1 tasks_processing.go:74] worker 17 stopped. I0506 03:07:16.653130 1 recorder.go:75] Recording config/node/ip-10-0-0-56.ec2.internal with fingerprint=17b7511a009fa0f0aa187d19476d6001cbf33d54becbe85772c26c82a22e5893 I0506 03:07:16.653328 1 recorder.go:75] Recording config/node/ip-10-0-1-194.ec2.internal with fingerprint=29a4c979aa4c2b600bf48cde685065a80643772cfd08d112f775e3173791153f I0506 03:07:16.653462 1 recorder.go:75] Recording config/node/ip-10-0-2-14.ec2.internal with fingerprint=b9d4ec002c34fb305302a1927cd04098392c9da79f6f1c7bcb9f1cea7555c8f8 I0506 03:07:16.653529 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 30.913197ms to process 3 records I0506 03:07:16.653858 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=860fac53ccdaf7fa74da5d134d31408bd7f4a070386c0e28cf8935100ef91281 I0506 03:07:16.654024 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=c54ce112e7f84b959bfb4fe0de0ad1cb59e75c3f1386dfad24061be09ae8306c I0506 03:07:16.654060 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=1ddee22b8b5f61742946dd12996914f7580a23284a707091cf958f7f748991f8 I0506 03:07:16.654069 1 tasks_processing.go:74] worker 41 stopped. I0506 03:07:16.654105 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=c75a6590a39da734ddba9007bf7576db8d847b92bde81cc1fd0b1dd34ade396c I0506 03:07:16.654150 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=d9b51c6224186c641d90f3237bb58ed13676a253fe4db09a87bfc1443b5d9043 I0506 03:07:16.654194 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=43aa42089dc7face1320bbc4fc15447ff1f5e11d4f6c4c500a625c1b37009978 I0506 03:07:16.654238 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=118ed9f28ecaaae740bfac4ad47003f1a20bce0c58a5b2bce8e1b3ecd8b94ef6 I0506 03:07:16.654442 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=93cce766c7b916454fe58495af7be28ccd37f09fda4c48cac3e8542d9bed9039 I0506 03:07:16.654545 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=ea65240f53f543a075472b7df956914b021f6a06b90d451f6a998e9e275420a7 I0506 03:07:16.654600 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=8df19faa2ca12eb1b2f056a4418c3feee018ca92f0472a0a00a64f82df5d4010 I0506 03:07:16.654658 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=2b2ac1a1f6db7b30de5e7a48f5a152030ffc5a6a957a82baeea2d4647241fc2d I0506 03:07:16.654670 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 30.657685ms to process 11 records I0506 03:07:16.654763 1 tasks_processing.go:74] worker 23 stopped. I0506 03:07:16.654777 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0506 03:07:16.654783 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 32.823213ms to process 1 records I0506 03:07:16.656874 1 tasks_processing.go:74] worker 32 stopped. E0506 03:07:16.656891 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0506 03:07:16.656920 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0506 03:07:16.656938 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 35.115734ms to process 1 records I0506 03:07:16.657004 1 tasks_processing.go:74] worker 53 stopped. I0506 03:07:16.657058 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=e4cc1bc2cf788a5b47ac045f68a9c688c6f2c27354534193b5c0275589378d6b I0506 03:07:16.657075 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 33.585584ms to process 1 records I0506 03:07:16.663058 1 tasks_processing.go:74] worker 57 stopped. I0506 03:07:16.663084 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 39.889864ms to process 0 records I0506 03:07:16.663215 1 tasks_processing.go:74] worker 54 stopped. I0506 03:07:16.663367 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=e2cc91c536d8d2e2250accb86c37a760877aeb126c4b6067ae5bd62b0f755874 I0506 03:07:16.663444 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=4ba53a2265616d8a6c4146d66ccaf76644f24d98c58c4eeef3bbc12dc0fa5479 I0506 03:07:16.663482 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=64ab18a5f50937591e601dd67447060355b26bd9ea49459372fc7330fb464c4e I0506 03:07:16.663495 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 39.645485ms to process 3 records I0506 03:07:16.663799 1 tasks_processing.go:74] worker 55 stopped. I0506 03:07:16.664225 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=40ff47e788ee931ff46391ec5f66d7f99c07804b77aa0d8fd20a2f9f513c54c4 I0506 03:07:16.664241 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 40.39582ms to process 1 records I0506 03:07:16.666623 1 tasks_processing.go:74] worker 60 stopped. I0506 03:07:16.666884 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b9c387e20b77732572af2410380749b0f03d1ec6840386f5aa08fda092a1491c I0506 03:07:16.666994 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=6ba076939e51d23eefde830875a79181fa51ee05e8ac3930e08446261b3e87e1 I0506 03:07:16.667005 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 44.607421ms to process 2 records I0506 03:07:16.667088 1 tasks_processing.go:74] worker 30 stopped. I0506 03:07:16.667237 1 recorder.go:75] Recording config/version with fingerprint=6efd4deb33d3665434288356c7e0da2034adfc44b9b477ef1d0d981cc1b2e026 I0506 03:07:16.667246 1 recorder.go:75] Recording config/id with fingerprint=04dbfd38ae37781fa7743183722890fae4d8e9bb4d0b41247805877c83410e4d I0506 03:07:16.667252 1 gather.go:177] gatherer "clusterconfig" function "version" took 44.304854ms to process 2 records I0506 03:07:16.667333 1 tasks_processing.go:74] worker 15 stopped. I0506 03:07:16.667717 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=46c618296a9a161002e88612e09fa79ee5504f6d07326c22a99152e638a8d599 I0506 03:07:16.667927 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=328e0a9a43370a333a93cd579deb1ee2b75a47c3733044292f51f1fe8dff49d1 I0506 03:07:16.667938 1 gather.go:177] gatherer "clusterconfig" function "crds" took 45.175061ms to process 2 records I0506 03:07:16.667951 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 45.150677ms to process 0 records I0506 03:07:16.667961 1 tasks_processing.go:74] worker 22 stopped. I0506 03:07:16.668720 1 tasks_processing.go:74] worker 12 stopped. I0506 03:07:16.668736 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 46.970914ms to process 0 records W0506 03:07:16.668769 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:07:16.669761 1 tasks_processing.go:74] worker 19 stopped. I0506 03:07:16.670897 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-d59n6 with fingerprint=343238f10d978624a15597301464103f8edcfd86b4539e627f84abe4b29b1d76 I0506 03:07:16.670945 1 recorder.go:75] Recording config/running_containers with fingerprint=1a992de6af85384d4e114190a01a6e14084b4e3cfabc1ea9c50c0a5f910e3a61 I0506 03:07:16.670954 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 47.558338ms to process 2 records I0506 03:07:16.674719 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0506 03:07:16.674795 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0506 03:07:16.674842 1 operator.go:328] started I0506 03:07:16.674864 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0506 03:07:16.675401 1 tasks_processing.go:74] worker 35 stopped. I0506 03:07:16.675449 1 recorder.go:75] Recording config/olm_operators with fingerprint=57a3034fa4f23650ea49c5d3af314ab5116c511b590f377bb24a54de5199147e I0506 03:07:16.675460 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 51.86504ms to process 1 records I0506 03:07:16.682809 1 tasks_processing.go:74] worker 0 stopped. I0506 03:07:16.682820 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 61.116175ms to process 0 records I0506 03:07:16.683192 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0506 03:07:16.683208 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0506 03:07:16.683215 1 controller.go:254] Source scaController *sca.Controller is not ready I0506 03:07:16.683219 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0506 03:07:16.683224 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0506 03:07:16.683243 1 controller.go:531] The operator is still being initialized I0506 03:07:16.683253 1 controller.go:554] The operator is healthy I0506 03:07:16.685140 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0506 03:07:16.685213 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0506 03:07:16.685213 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0506 03:07:16.689958 1 base_controller.go:82] Caches are synced for ConfigController I0506 03:07:16.689969 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0506 03:07:16.690114 1 prometheus_rules.go:88] Prometheus rules successfully created I0506 03:07:16.690534 1 tasks_processing.go:74] worker 1 stopped. E0506 03:07:16.690554 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0506 03:07:16.690565 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0506 03:07:16.690568 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0506 03:07:16.690578 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0506 03:07:16.690633 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0506 03:07:16.690644 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0506 03:07:16.690651 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0506 03:07:16.690656 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0506 03:07:16.690736 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0506 03:07:16.690751 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0506 03:07:16.690759 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 68.832958ms to process 7 records E0506 03:07:16.690852 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27f2124f23-7cb5-4b6c-8743-2894a06a4dfa%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.9:60747->172.30.0.10:53: read: connection refused I0506 03:07:16.690863 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27f2124f23-7cb5-4b6c-8743-2894a06a4dfa%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.9:60747->172.30.0.10:53: read: connection refused I0506 03:07:16.694573 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:07:16.700049 1 tasks_processing.go:74] worker 3 stopped. I0506 03:07:16.700158 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=df9aa3a8a58f8367dcf5367870e4c864476a660c8405b7a4608b3b7353b459f5 I0506 03:07:16.700187 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=09553e96d5de16a01360e2bcf1c5d0a805f7c802e497b9bd6a87aaa64e5f221d I0506 03:07:16.700211 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=57100b29183c9da6924cb16323cbecbb89109f458cc0e7cddf58076a92755146 I0506 03:07:16.700218 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 77.621179ms to process 3 records I0506 03:07:16.741686 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0506 03:07:16.744888 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.9:35516->172.30.0.10:53: read: connection refused I0506 03:07:16.744899 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.9:35516->172.30.0.10:53: read: connection refused I0506 03:07:16.773760 1 tasks_processing.go:74] worker 48 stopped. E0506 03:07:16.773779 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0506 03:07:16.773788 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q45svcivdm15p3pj0gf8q8sbn6f50mb-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q45svcivdm15p3pj0gf8q8sbn6f50mb-primary-cert-bundle-secret" not found I0506 03:07:16.773858 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=f648f5d23e9f5859ae90a0a34eeacd412f1ba52a49c8549f8386ac41b401a106 I0506 03:07:16.773879 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 151.121676ms to process 1 records I0506 03:07:16.774925 1 base_controller.go:82] Caches are synced for LoggingSyncer I0506 03:07:16.774939 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0506 03:07:17.068969 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0506 03:07:17.068983 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0506 03:07:17.070529 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-4gd69 pod in namespace openshift-dns (previous: false). I0506 03:07:17.292531 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-4gd69 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-4gd69\" is waiting to start: ContainerCreating" I0506 03:07:17.292548 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-4gd69\" is waiting to start: ContainerCreating" I0506 03:07:17.292556 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-4gd69 pod in namespace openshift-dns (previous: false). I0506 03:07:17.473665 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-4gd69 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-4gd69\" is waiting to start: ContainerCreating" I0506 03:07:17.473698 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-4gd69\" is waiting to start: ContainerCreating" I0506 03:07:17.473712 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-rhkkw pod in namespace openshift-dns (previous: false). W0506 03:07:17.667042 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:07:17.698712 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-rhkkw pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-rhkkw\" is waiting to start: ContainerCreating" I0506 03:07:17.698726 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-rhkkw\" is waiting to start: ContainerCreating" I0506 03:07:17.698735 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-rhkkw pod in namespace openshift-dns (previous: false). I0506 03:07:17.874037 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-rhkkw pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-rhkkw\" is waiting to start: ContainerCreating" I0506 03:07:17.874052 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-rhkkw\" is waiting to start: ContainerCreating" I0506 03:07:17.874061 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-wj9t8 pod in namespace openshift-dns (previous: false). I0506 03:07:18.082318 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0506 03:07:18.091631 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-wj9t8 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-wj9t8\" is waiting to start: ContainerCreating" I0506 03:07:18.091644 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-wj9t8\" is waiting to start: ContainerCreating" I0506 03:07:18.091651 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-wj9t8 pod in namespace openshift-dns (previous: false). I0506 03:07:18.273820 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-wj9t8 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-wj9t8\" is waiting to start: ContainerCreating" I0506 03:07:18.273837 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-wj9t8\" is waiting to start: ContainerCreating" I0506 03:07:18.273848 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-8gppk pod in namespace openshift-dns (previous: false). I0506 03:07:18.477995 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:07:18.478013 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-hzmvb pod in namespace openshift-dns (previous: false). W0506 03:07:18.666718 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:07:18.673964 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:07:18.673978 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-jmrdz pod in namespace openshift-dns (previous: false). I0506 03:07:18.685062 1 tasks_processing.go:74] worker 9 stopped. I0506 03:07:18.685114 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=1d2d91bcbe6890da9e75a28cd8becd0e7f99ae7ff15f20f995557161e592f3f5 I0506 03:07:18.685159 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=4f6d663e7946240c4ca51a766ad7f315f054aef1b66f13f933530314b2c87f59 I0506 03:07:18.685192 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0506 03:07:18.685219 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=7c44bec5042f73bc531e050aa68911fb17196e9f21e777990deebf8a8d1d217b I0506 03:07:18.685251 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0506 03:07:18.685281 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=5ddf826f5881636cf239aee10c9997ba8a7b1cc6cc8293d89bed5840e9268803 I0506 03:07:18.685311 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=c0fdec01bf6be95d9be489084a50223d0f0ba8c4b148f2855763941b78c6db63 I0506 03:07:18.685337 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=dafca4be771e3f7863893e6e043a73167d044a4d09a9ca4ac296dc28ba4b8a12 I0506 03:07:18.685356 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=7c2a1a7fda91c527fe1a7526e4807c7cee32813318aef1c6d7fc1b93b07ff36d I0506 03:07:18.685376 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=5140793fa461c3db7d52a5d2eea7f47ba8b19372a6009ab938cec20ca5429db9 I0506 03:07:18.685387 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0506 03:07:18.685404 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=96cc02a2e2ad3b27453c28ff87ba132d7b6ef436a82f5cd821b8accce47b5c69 I0506 03:07:18.685413 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0506 03:07:18.685437 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=c712959efdd9a10417e0693316e4cdd580000d6b792ab2210cc56780d90ce73c I0506 03:07:18.685447 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0506 03:07:18.685466 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=b8ff3ac0d03d9027940c6a51b9260cecebb62bfaa1c12c13aded53b2f4d3876b I0506 03:07:18.685476 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0506 03:07:18.685491 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=f53f32cd283e9761a75ff1e5535176edb4f7da83fa292cc15c017fccd623f74d I0506 03:07:18.685626 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=4e5e82de70cda6ee2213b0869b207d0126c9eddfd699271f44d72f120df534fa I0506 03:07:18.685639 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0506 03:07:18.685646 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0506 03:07:18.685688 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0506 03:07:18.685713 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=7656c3b4f96c7d85a5dc2b0fb280aab35892e0359a0015916a2b45246097adf3 I0506 03:07:18.685738 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=e29d19030b61e48ae05350d25336b5ec81d73f9c4059392d5be91692db4f0440 I0506 03:07:18.685751 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0506 03:07:18.685767 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=c928233228932b452d6a5ce57fae8655edac6e5c6b8139fc8a74e46d345220d2 I0506 03:07:18.685776 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0506 03:07:18.685789 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=0dee35d39795b426b33114120009154da74125f41ce78cea615d32a8f6441a05 I0506 03:07:18.685803 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=01b639a5955667a21f05d3e2bf8931fea9cce6fbcc6578661d7b5de595a488f6 I0506 03:07:18.685820 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=6373c404bbd706989656bc42e3244bacea86414c187a1152ce02a9b0f5868fb2 I0506 03:07:18.685840 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=1209528173ec29b8baf2245c175edc7d16d5d57097cf127fdbc48bbe96e07d47 I0506 03:07:18.685859 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=4bee1fcf6399b6f18a4d9c2e0378c4b49ded87034fb678edfe403d48d2285318 I0506 03:07:18.685868 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0506 03:07:18.685895 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=02002fe9e2d736bfb17167277f0e2222839fa4989e10b2282a80cd1576c8992b I0506 03:07:18.685916 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0506 03:07:18.685926 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0506 03:07:18.685933 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.062200954s to process 36 records I0506 03:07:18.874933 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:07:18.874988 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5bcf5547c-7s2vr pod in namespace openshift-image-registry (previous: false). I0506 03:07:19.085767 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5bcf5547c-7s2vr pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5bcf5547c-7s2vr\" is waiting to start: ContainerCreating" I0506 03:07:19.085783 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5bcf5547c-7s2vr\" is waiting to start: ContainerCreating" I0506 03:07:19.085831 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5bcf5547c-qx59n pod in namespace openshift-image-registry (previous: false). I0506 03:07:19.274609 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5bcf5547c-qx59n pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5bcf5547c-qx59n\" is waiting to start: ContainerCreating" I0506 03:07:19.274624 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5bcf5547c-qx59n\" is waiting to start: ContainerCreating" I0506 03:07:19.274665 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-b997bbb4b-hvzbg pod in namespace openshift-image-registry (previous: false). I0506 03:07:19.474242 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-b997bbb4b-hvzbg pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-b997bbb4b-hvzbg\" is waiting to start: ContainerCreating" I0506 03:07:19.474258 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-b997bbb4b-hvzbg\" is waiting to start: ContainerCreating" I0506 03:07:19.474277 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-8mqck pod in namespace openshift-image-registry (previous: false). W0506 03:07:19.666374 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:07:19.673831 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:07:19.673845 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-bxtb4 pod in namespace openshift-image-registry (previous: false). I0506 03:07:19.873665 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:07:19.873695 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-jrj2z pod in namespace openshift-image-registry (previous: false). I0506 03:07:20.074048 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:07:20.074066 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6768b979cc-d7zwg pod in namespace openshift-ingress (previous: false). I0506 03:07:20.274536 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6768b979cc-d7zwg pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6768b979cc-d7zwg\" is waiting to start: ContainerCreating" I0506 03:07:20.274551 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6768b979cc-d7zwg\" is waiting to start: ContainerCreating" I0506 03:07:20.274561 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6df6555f7c-9pcwq pod in namespace openshift-ingress (previous: false). I0506 03:07:20.494953 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6df6555f7c-9pcwq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6df6555f7c-9pcwq\" is waiting to start: ContainerCreating" I0506 03:07:20.494970 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6df6555f7c-9pcwq\" is waiting to start: ContainerCreating" I0506 03:07:20.494980 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6df6555f7c-xjxpz pod in namespace openshift-ingress (previous: false). W0506 03:07:20.666793 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:07:20.691820 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6df6555f7c-xjxpz pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6df6555f7c-xjxpz\" is waiting to start: ContainerCreating" I0506 03:07:20.691834 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6df6555f7c-xjxpz\" is waiting to start: ContainerCreating" I0506 03:07:20.691847 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-bgv57 pod in namespace openshift-ingress-canary (previous: false). I0506 03:07:20.896775 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-r8f5v pod in namespace openshift-ingress-canary (previous: false). I0506 03:07:21.109663 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-rl645 pod in namespace openshift-ingress-canary (previous: false). I0506 03:07:21.278459 1 tasks_processing.go:74] worker 59 stopped. I0506 03:07:21.278559 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=386292e0371e18dd376fc31362b0abd749ff4a530d05ea4026f93b6d96ea3ac9 I0506 03:07:21.278611 1 recorder.go:75] Recording events/openshift-dns with fingerprint=d68849bee9a7670e54cdb672b4dae96cfc4dd1fee5cb9c0da840f44244a50b73 I0506 03:07:21.278740 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=31782bfd4ddae787fb1afee702fa4bb3805641269b3eef48dffe5eddab49ea4f I0506 03:07:21.278769 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=3657b29e0d428f9173e2a9b307207a0698578eb56defc945c57a0476dc526c8e I0506 03:07:21.278817 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=4d57fa69d1812da3043727da9f898e5b3a7fcd82fe7eb19a7f3282456a827b2c I0506 03:07:21.278855 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=9386f98c7cbbb51626f2b28872701f839e01116df76bee7209938fed954da687 I0506 03:07:21.278987 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-4gd69 with fingerprint=1de745e3a3de72621c938da57f3552f2d67fc7654ee5698b87e3559647b0fafb I0506 03:07:21.279100 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5bcf5547c-7s2vr with fingerprint=9a1a638d44d40f2354c0863cc73c731ee3582c6bb77bc9ca1eb09827619f3a7f I0506 03:07:21.279197 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5bcf5547c-qx59n with fingerprint=e79f9fd055877a846bfe3c66ce8c7a77cf18c1bee4dc2e6e5c4b4168df97b113 I0506 03:07:21.279287 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-b997bbb4b-hvzbg with fingerprint=a7c4402787d43f4693ecf0e3c33c4a2a782a360aac38f2a0c4fad780f397afcf I0506 03:07:21.279294 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-bgv57/serve-healthcheck-canary_current.log with fingerprint=5bc2b10c295368c81883b1c9432f075c0b2107010cc72f4f2aa4c80ddcb7bbb3 I0506 03:07:21.279300 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-r8f5v/serve-healthcheck-canary_current.log with fingerprint=603ea8238f778c16b83d7cf1c1a010d231b209fce0fa23c4aa778766752f103f I0506 03:07:21.279305 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-rl645/serve-healthcheck-canary_current.log with fingerprint=cb7cc3cb8c49855136be35b7007cd520be7e6a22689d0e80e73788fb653b3826 I0506 03:07:21.279311 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.655126938s to process 13 records W0506 03:07:21.667154 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0506 03:07:21.667178 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0506 03:07:21.667194 1 tasks_processing.go:74] worker 26 stopped. E0506 03:07:21.667205 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0506 03:07:21.667216 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0506 03:07:21.667230 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0506 03:07:21.667242 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.044368553s to process 1 records I0506 03:07:26.945110 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:07:29.466941 1 tasks_processing.go:74] worker 45 stopped. I0506 03:07:29.466981 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0506 03:07:29.466994 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.843789495s to process 1 records I0506 03:07:29.623410 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:07:29.823256 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:07:30.227721 1 tasks_processing.go:74] worker 33 stopped. I0506 03:07:30.227974 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=c78e5795a67ab51fe09c549dd5ffc4d388fc13c289f433574478c3e99cebdbf5 I0506 03:07:30.227990 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605634856s to process 1 records E0506 03:07:30.228058 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.606s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0506 03:07:30.229161 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0506 03:07:30.229175 1 periodic.go:216] Running workloads gatherer I0506 03:07:30.229190 1 tasks_processing.go:45] number of workers: 2 I0506 03:07:30.229196 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 03:07:30.229200 1 tasks_processing.go:71] worker 1 working on workload_info task. I0506 03:07:30.229206 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 03:07:30.229226 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0506 03:07:30.252006 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0506 03:07:30.259990 1 tasks_processing.go:74] worker 0 stopped. I0506 03:07:30.260006 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.746044ms to process 0 records I0506 03:07:30.261235 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (10ms) I0506 03:07:30.270246 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (9ms) I0506 03:07:30.279889 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (10ms) I0506 03:07:30.291049 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (11ms) I0506 03:07:30.300268 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (9ms) I0506 03:07:30.308797 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (9ms) I0506 03:07:30.317098 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (8ms) I0506 03:07:30.325970 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (9ms) I0506 03:07:30.334167 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (8ms) I0506 03:07:30.342551 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (8ms) I0506 03:07:30.360113 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (18ms) I0506 03:07:30.461788 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (102ms) I0506 03:07:30.561307 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (99ms) I0506 03:07:30.661086 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (100ms) I0506 03:07:30.761665 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (101ms) I0506 03:07:30.861123 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (99ms) I0506 03:07:30.960817 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (100ms) I0506 03:07:31.061456 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (101ms) I0506 03:07:31.161274 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms) I0506 03:07:31.261919 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (101ms) I0506 03:07:31.361661 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (100ms) I0506 03:07:31.461489 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (100ms) I0506 03:07:31.561542 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms) I0506 03:07:31.661547 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (100ms) I0506 03:07:31.761110 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (100ms) I0506 03:07:31.862586 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (101ms) I0506 03:07:31.960856 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (98ms) I0506 03:07:32.062624 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (102ms) I0506 03:07:32.162114 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (99ms) I0506 03:07:32.261547 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (99ms) I0506 03:07:32.360845 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (99ms) I0506 03:07:32.461879 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (101ms) I0506 03:07:32.560961 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (99ms) I0506 03:07:32.560990 1 tasks_processing.go:74] worker 1 stopped. E0506 03:07:32.561000 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0506 03:07:32.561247 1 recorder.go:75] Recording config/workload_info with fingerprint=525667d9cb5e9f4a0ae877a95da717bc2aa59a144234a493786bd9944f7283c0 I0506 03:07:32.561262 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.331783385s to process 1 records E0506 03:07:32.561287 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.332s with: function \"workload_info\" failed with an error" I0506 03:07:32.562387 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0506 03:07:32.562398 1 periodic.go:216] Running conditional gatherer I0506 03:07:32.567479 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0506 03:07:32.574106 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.9:50381->172.30.0.10:53: read: connection refused E0506 03:07:32.574387 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 03:07:32.574441 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0506 03:07:32.579427 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0506 03:07:32.579440 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:07:32.579446 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:07:32.579449 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:07:32.579453 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:07:32.579457 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:07:32.579460 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:07:32.579463 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:07:32.579466 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:07:32.579469 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0506 03:07:32.579482 1 tasks_processing.go:45] number of workers: 3 I0506 03:07:32.579491 1 tasks_processing.go:69] worker 2 listening for tasks. I0506 03:07:32.579497 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0506 03:07:32.579500 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 03:07:32.579509 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0506 03:07:32.579512 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 03:07:32.579515 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0506 03:07:32.579519 1 tasks_processing.go:74] worker 1 stopped. I0506 03:07:32.579567 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0506 03:07:32.579579 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 885ns to process 1 records I0506 03:07:32.579609 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0506 03:07:32.579616 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.158µs to process 1 records I0506 03:07:32.579621 1 tasks_processing.go:74] worker 0 stopped. I0506 03:07:32.579762 1 tasks_processing.go:74] worker 2 stopped. I0506 03:07:32.579774 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 240.774µs to process 0 records I0506 03:07:32.579792 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.9:50381->172.30.0.10:53: read: connection refused I0506 03:07:32.579809 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0506 03:07:32.600449 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=4f8ca0430e282761d143ac85c02f8803d7daf350b563a191e1441411a2714e79 I0506 03:07:32.600575 1 diskrecorder.go:70] Writing 109 records to /var/lib/insights-operator/insights-2026-05-06-030732.tar.gz I0506 03:07:32.607245 1 diskrecorder.go:51] Wrote 109 records to disk in 6ms I0506 03:07:32.607271 1 periodic.go:285] Gathering cluster info every 2h0m0s I0506 03:07:32.607285 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0506 03:07:42.296572 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:08:35.883536 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="2698e1e3ed1adf7c5658ce93a7b7b59b46436b845057c4a500ec73137ce5414e") W0506 03:08:35.883571 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0506 03:08:35.883616 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="257c1b1c70c35adbced84dd4b7db247a79c118be279cca7de24ec32ee3034488") I0506 03:08:35.883642 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"