W0506 20:12:26.734530 1 cmd.go:257] Using insecure, self-signed certificates I0506 20:12:27.014939 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 20:12:27.015239 1 observer_polling.go:159] Starting file observer I0506 20:12:27.335461 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0506 20:12:27.335705 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0506 20:12:27.336525 1 secure_serving.go:57] Forcing use of http/1.1 only I0506 20:12:27.336540 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0506 20:12:27.336545 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0506 20:12:27.336570 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0506 20:12:27.336581 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0506 20:12:27.336584 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0506 20:12:27.336587 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0506 20:12:27.336591 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0506 20:12:27.339936 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0506 20:12:27.339947 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"1e402227-4f95-4c31-8632-8da35ea818cf", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0506 20:12:27.341632 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0506 20:12:27.341645 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0506 20:12:27.341665 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0506 20:12:27.341683 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0506 20:12:27.341667 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0506 20:12:27.341695 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0506 20:12:27.342006 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1162682070/tls.crt::/tmp/serving-cert-1162682070/tls.key" I0506 20:12:27.342336 1 secure_serving.go:213] Serving securely on [::]:8443 I0506 20:12:27.342361 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0506 20:12:27.345980 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0506 20:12:27.346005 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0506 20:12:27.346090 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0506 20:12:27.354401 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 20:12:27.354423 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0506 20:12:27.360478 1 secretconfigobserver.go:119] support secret does not exist I0506 20:12:27.364586 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 20:12:27.368713 1 secretconfigobserver.go:119] support secret does not exist I0506 20:12:27.371155 1 recorder.go:176] Pruning old reports every 8h30m47s, max age is 288h0m0s I0506 20:12:27.378384 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0506 20:12:27.378399 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0506 20:12:27.378409 1 insightsreport.go:296] Starting report retriever I0506 20:12:27.378414 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0506 20:12:27.378400 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0506 20:12:27.378385 1 periodic.go:216] Running clusterconfig gatherer I0506 20:12:27.378461 1 tasks_processing.go:45] number of workers: 64 I0506 20:12:27.378486 1 tasks_processing.go:69] worker 2 listening for tasks. I0506 20:12:27.378498 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 20:12:27.378504 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 20:12:27.378507 1 tasks_processing.go:69] worker 36 listening for tasks. I0506 20:12:27.378504 1 tasks_processing.go:71] worker 0 working on machine_config_pools task. I0506 20:12:27.378513 1 tasks_processing.go:71] worker 36 working on machines task. I0506 20:12:27.378516 1 tasks_processing.go:69] worker 38 listening for tasks. I0506 20:12:27.378516 1 tasks_processing.go:69] worker 3 listening for tasks. I0506 20:12:27.378510 1 tasks_processing.go:69] worker 37 listening for tasks. I0506 20:12:27.378523 1 tasks_processing.go:69] worker 4 listening for tasks. I0506 20:12:27.378527 1 tasks_processing.go:69] worker 39 listening for tasks. I0506 20:12:27.378531 1 tasks_processing.go:69] worker 40 listening for tasks. I0506 20:12:27.378528 1 tasks_processing.go:69] worker 27 listening for tasks. I0506 20:12:27.378537 1 tasks_processing.go:69] worker 5 listening for tasks. I0506 20:12:27.378540 1 tasks_processing.go:69] worker 41 listening for tasks. I0506 20:12:27.378539 1 tasks_processing.go:69] worker 20 listening for tasks. I0506 20:12:27.378544 1 tasks_processing.go:69] worker 13 listening for tasks. I0506 20:12:27.378544 1 tasks_processing.go:69] worker 32 listening for tasks. I0506 20:12:27.378552 1 tasks_processing.go:69] worker 14 listening for tasks. I0506 20:12:27.378552 1 tasks_processing.go:69] worker 43 listening for tasks. I0506 20:12:27.378548 1 tasks_processing.go:69] worker 42 listening for tasks. I0506 20:12:27.378555 1 tasks_processing.go:69] worker 22 listening for tasks. I0506 20:12:27.378558 1 tasks_processing.go:69] worker 12 listening for tasks. I0506 20:12:27.378567 1 tasks_processing.go:69] worker 45 listening for tasks. I0506 20:12:27.378563 1 tasks_processing.go:69] worker 44 listening for tasks. I0506 20:12:27.378574 1 tasks_processing.go:69] worker 23 listening for tasks. I0506 20:12:27.378570 1 tasks_processing.go:69] worker 16 listening for tasks. I0506 20:12:27.378578 1 tasks_processing.go:69] worker 56 listening for tasks. I0506 20:12:27.378581 1 tasks_processing.go:69] worker 6 listening for tasks. I0506 20:12:27.378584 1 tasks_processing.go:69] worker 26 listening for tasks. I0506 20:12:27.378585 1 tasks_processing.go:69] worker 48 listening for tasks. I0506 20:12:27.378587 1 tasks_processing.go:69] worker 15 listening for tasks. I0506 20:12:27.378592 1 tasks_processing.go:69] worker 10 listening for tasks. I0506 20:12:27.378594 1 tasks_processing.go:69] worker 34 listening for tasks. I0506 20:12:27.378590 1 tasks_processing.go:69] worker 31 listening for tasks. I0506 20:12:27.378599 1 tasks_processing.go:69] worker 8 listening for tasks. I0506 20:12:27.378600 1 tasks_processing.go:69] worker 11 listening for tasks. I0506 20:12:27.378603 1 tasks_processing.go:69] worker 33 listening for tasks. I0506 20:12:27.378604 1 tasks_processing.go:69] worker 51 listening for tasks. I0506 20:12:27.378607 1 tasks_processing.go:69] worker 54 listening for tasks. I0506 20:12:27.378608 1 tasks_processing.go:69] worker 62 listening for tasks. I0506 20:12:27.378610 1 tasks_processing.go:69] worker 63 listening for tasks. I0506 20:12:27.378613 1 tasks_processing.go:71] worker 2 working on nodenetworkstates task. I0506 20:12:27.378612 1 tasks_processing.go:69] worker 52 listening for tasks. I0506 20:12:27.378616 1 tasks_processing.go:69] worker 61 listening for tasks. I0506 20:12:27.378605 1 tasks_processing.go:69] worker 9 listening for tasks. I0506 20:12:27.378505 1 tasks_processing.go:69] worker 19 listening for tasks. I0506 20:12:27.378589 1 tasks_processing.go:69] worker 24 listening for tasks. I0506 20:12:27.378547 1 tasks_processing.go:69] worker 21 listening for tasks. I0506 20:12:27.378559 1 tasks_processing.go:69] worker 28 listening for tasks. I0506 20:12:27.378561 1 tasks_processing.go:69] worker 17 listening for tasks. I0506 20:12:27.378565 1 tasks_processing.go:69] worker 29 listening for tasks. I0506 20:12:27.378567 1 tasks_processing.go:69] worker 18 listening for tasks. I0506 20:12:27.378574 1 tasks_processing.go:69] worker 46 listening for tasks. I0506 20:12:27.378570 1 tasks_processing.go:69] worker 30 listening for tasks. I0506 20:12:27.378575 1 tasks_processing.go:69] worker 55 listening for tasks. I0506 20:12:27.378580 1 tasks_processing.go:69] worker 47 listening for tasks. I0506 20:12:27.378584 1 tasks_processing.go:69] worker 25 listening for tasks. I0506 20:12:27.378647 1 tasks_processing.go:69] worker 53 listening for tasks. I0506 20:12:27.378586 1 tasks_processing.go:69] worker 57 listening for tasks. I0506 20:12:27.378591 1 tasks_processing.go:69] worker 58 listening for tasks. I0506 20:12:27.378595 1 tasks_processing.go:69] worker 49 listening for tasks. I0506 20:12:27.378599 1 tasks_processing.go:69] worker 50 listening for tasks. I0506 20:12:27.378600 1 tasks_processing.go:69] worker 59 listening for tasks. I0506 20:12:27.378600 1 tasks_processing.go:69] worker 7 listening for tasks. I0506 20:12:27.378610 1 tasks_processing.go:69] worker 35 listening for tasks. I0506 20:12:27.378612 1 tasks_processing.go:69] worker 60 listening for tasks. I0506 20:12:27.378508 1 tasks_processing.go:71] worker 1 working on validating_webhook_configurations task. I0506 20:12:27.378689 1 tasks_processing.go:71] worker 8 working on proxies task. I0506 20:12:27.378693 1 tasks_processing.go:71] worker 11 working on ingress task. I0506 20:12:27.378695 1 tasks_processing.go:71] worker 13 working on node_features task. I0506 20:12:27.378700 1 tasks_processing.go:71] worker 3 working on dvo_metrics task. I0506 20:12:27.378700 1 tasks_processing.go:71] worker 60 working on sap_pods task. I0506 20:12:27.378748 1 tasks_processing.go:71] worker 42 working on storage_classes task. I0506 20:12:27.378763 1 tasks_processing.go:71] worker 30 working on service_accounts task. I0506 20:12:27.378767 1 tasks_processing.go:71] worker 4 working on container_images task. I0506 20:12:27.378768 1 tasks_processing.go:71] worker 14 working on infrastructures task. I0506 20:12:27.378785 1 tasks_processing.go:71] worker 27 working on container_runtime_configs task. I0506 20:12:27.378797 1 tasks_processing.go:71] worker 21 working on authentication task. I0506 20:12:27.378825 1 tasks_processing.go:71] worker 29 working on silenced_alerts task. I0506 20:12:27.378830 1 tasks_processing.go:71] worker 39 working on storage_cluster task. I0506 20:12:27.378842 1 tasks_processing.go:71] worker 56 working on nodenetworkconfigurationpolicies task. I0506 20:12:27.378844 1 tasks_processing.go:71] worker 46 working on openshift_machine_api_events task. W0506 20:12:27.378876 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 20:12:27.378895 1 tasks_processing.go:71] worker 29 working on ceph_cluster task. I0506 20:12:27.378925 1 tasks_processing.go:71] worker 5 working on openstack_version task. I0506 20:12:27.378930 1 tasks_processing.go:71] worker 40 working on openstack_dataplanenodesets task. I0506 20:12:27.378946 1 tasks_processing.go:71] worker 22 working on image_pruners task. I0506 20:12:27.378954 1 tasks_processing.go:71] worker 32 working on ingress_certificates task. I0506 20:12:27.378985 1 tasks_processing.go:71] worker 52 working on image_registries task. I0506 20:12:27.378994 1 tasks_processing.go:71] worker 6 working on cost_management_metrics_configs task. I0506 20:12:27.379004 1 tasks_processing.go:71] worker 10 working on config_maps task. I0506 20:12:27.379085 1 tasks_processing.go:71] worker 28 working on machine_sets task. I0506 20:12:27.379101 1 tasks_processing.go:71] worker 9 working on networks task. I0506 20:12:27.378763 1 tasks_processing.go:71] worker 37 working on oauths task. I0506 20:12:27.379188 1 tasks_processing.go:71] worker 26 working on pod_network_connectivity_checks task. I0506 20:12:27.379255 1 tasks_processing.go:71] worker 17 working on node_logs task. I0506 20:12:27.378696 1 tasks_processing.go:71] worker 38 working on openstack_controlplanes task. I0506 20:12:27.379280 1 tasks_processing.go:71] worker 55 working on machine_configs task. I0506 20:12:27.379302 1 tasks_processing.go:71] worker 61 working on clusterroles task. I0506 20:12:27.379376 1 tasks_processing.go:71] worker 58 working on certificate_signing_requests task. I0506 20:12:27.378837 1 tasks_processing.go:71] worker 16 working on sap_datahubs task. I0506 20:12:27.379410 1 tasks_processing.go:71] worker 41 working on schedulers task. I0506 20:12:27.379417 1 tasks_processing.go:71] worker 48 working on jaegers task. I0506 20:12:27.379451 1 tasks_processing.go:71] worker 19 working on active_alerts task. I0506 20:12:27.379476 1 tasks_processing.go:71] worker 24 working on openshift_logging task. W0506 20:12:27.379485 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 20:12:27.379497 1 tasks_processing.go:71] worker 45 working on cluster_apiserver task. I0506 20:12:27.378839 1 tasks_processing.go:71] worker 18 working on qemu_kubevirt_launcher_logs task. I0506 20:12:27.379534 1 tasks_processing.go:71] worker 50 working on aggregated_monitoring_cr_names task. I0506 20:12:27.379580 1 tasks_processing.go:71] worker 44 working on nodes task. I0506 20:12:27.379618 1 tasks_processing.go:71] worker 25 working on support_secret task. I0506 20:12:27.379645 1 tasks_processing.go:71] worker 12 working on operators task. I0506 20:12:27.378988 1 tasks_processing.go:71] worker 15 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0506 20:12:27.379691 1 tasks_processing.go:71] worker 59 working on image task. I0506 20:12:27.379738 1 tasks_processing.go:71] worker 31 working on machine_autoscalers task. I0506 20:12:27.379401 1 tasks_processing.go:71] worker 43 working on monitoring_persistent_volumes task. I0506 20:12:27.379759 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 49.181µs to process 0 records I0506 20:12:27.379772 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 26.361µs to process 0 records I0506 20:12:27.379780 1 tasks_processing.go:71] worker 47 working on feature_gates task. I0506 20:12:27.379876 1 tasks_processing.go:71] worker 7 working on mutating_webhook_configurations task. I0506 20:12:27.378690 1 tasks_processing.go:71] worker 20 working on operators_pods_and_events task. I0506 20:12:27.379901 1 tasks_processing.go:71] worker 54 working on overlapping_namespace_uids task. I0506 20:12:27.380012 1 tasks_processing.go:71] worker 35 working on version task. I0506 20:12:27.379529 1 tasks_processing.go:71] worker 49 working on machine_healthchecks task. I0506 20:12:27.380130 1 tasks_processing.go:71] worker 57 working on install_plans task. I0506 20:12:27.379905 1 tasks_processing.go:71] worker 33 working on tsdb_status task. I0506 20:12:27.378689 1 tasks_processing.go:71] worker 63 working on lokistack task. W0506 20:12:27.380289 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 20:12:27.380303 1 tasks_processing.go:74] worker 33 stopped. I0506 20:12:27.379914 1 tasks_processing.go:71] worker 19 working on crds task. I0506 20:12:27.380315 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 29.961µs to process 0 records I0506 20:12:27.379909 1 tasks_processing.go:71] worker 51 working on metrics task. I0506 20:12:27.378689 1 tasks_processing.go:71] worker 23 working on olm_operators task. W0506 20:12:27.380349 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 20:12:27.380367 1 tasks_processing.go:74] worker 51 stopped. I0506 20:12:27.380379 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 35.422µs to process 0 records I0506 20:12:27.379922 1 tasks_processing.go:71] worker 34 working on pdbs task. I0506 20:12:27.379926 1 tasks_processing.go:71] worker 53 working on openstack_dataplanedeployments task. I0506 20:12:27.379918 1 tasks_processing.go:71] worker 62 working on sap_config task. I0506 20:12:27.383922 1 tasks_processing.go:74] worker 2 stopped. I0506 20:12:27.383937 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 5.301884ms to process 0 records I0506 20:12:27.383945 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 5.420739ms to process 0 records I0506 20:12:27.383950 1 tasks_processing.go:74] worker 0 stopped. I0506 20:12:27.384031 1 tasks_processing.go:74] worker 36 stopped. E0506 20:12:27.384043 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0506 20:12:27.384051 1 gather.go:177] gatherer "clusterconfig" function "machines" took 5.505844ms to process 0 records I0506 20:12:27.390755 1 tasks_processing.go:74] worker 29 stopped. E0506 20:12:27.390758 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0506 20:12:27.390772 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 11.85251ms to process 0 records I0506 20:12:27.390780 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 12.066676ms to process 0 records I0506 20:12:27.390788 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 11.931595ms to process 0 records I0506 20:12:27.390791 1 tasks_processing.go:74] worker 13 stopped. I0506 20:12:27.390795 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 11.844728ms to process 0 records I0506 20:12:27.390799 1 tasks_processing.go:74] worker 5 stopped. I0506 20:12:27.390802 1 tasks_processing.go:74] worker 56 stopped. I0506 20:12:27.390807 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 11.782824ms to process 0 records I0506 20:12:27.390813 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 11.70115ms to process 0 records I0506 20:12:27.390814 1 tasks_processing.go:74] worker 6 stopped. I0506 20:12:27.390817 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 12.093219ms to process 0 records I0506 20:12:27.390820 1 tasks_processing.go:74] worker 28 stopped. I0506 20:12:27.390821 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 11.96663ms to process 0 records I0506 20:12:27.390824 1 tasks_processing.go:74] worker 39 stopped. I0506 20:12:27.390829 1 tasks_processing.go:74] worker 60 stopped. I0506 20:12:27.390908 1 tasks_processing.go:74] worker 16 stopped. I0506 20:12:27.390922 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 11.496652ms to process 0 records I0506 20:12:27.390932 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 12.131411ms to process 0 records I0506 20:12:27.390938 1 tasks_processing.go:74] worker 27 stopped. I0506 20:12:27.391024 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0506 20:12:27.391040 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0506 20:12:27.391045 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0506 20:12:27.391048 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0506 20:12:27.391062 1 controller.go:531] The operator is still being initialized I0506 20:12:27.391070 1 controller.go:554] The operator is healthy I0506 20:12:27.391117 1 tasks_processing.go:74] worker 38 stopped. I0506 20:12:27.391129 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 11.847708ms to process 0 records E0506 20:12:27.391142 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0506 20:12:27.391151 1 tasks_processing.go:74] worker 26 stopped. I0506 20:12:27.391152 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 11.905376ms to process 0 records I0506 20:12:27.391192 1 tasks_processing.go:74] worker 40 stopped. I0506 20:12:27.391205 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 12.243603ms to process 0 records I0506 20:12:27.397813 1 tasks_processing.go:74] worker 24 stopped. I0506 20:12:27.397826 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 18.326217ms to process 0 records I0506 20:12:27.397835 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 18.389631ms to process 0 records I0506 20:12:27.397840 1 tasks_processing.go:74] worker 48 stopped. I0506 20:12:27.398045 1 tasks_processing.go:74] worker 21 stopped. I0506 20:12:27.398281 1 recorder.go:75] Recording config/authentication with fingerprint=fdfd650b83c87ac226d4ce499a5bf4044803bd4de435a8bbafced63306e74717 I0506 20:12:27.398297 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 19.233186ms to process 1 records I0506 20:12:27.398389 1 tasks_processing.go:74] worker 11 stopped. I0506 20:12:27.398426 1 recorder.go:75] Recording config/ingress with fingerprint=4165227867af2ec091b713b2d0857044661e9694d22c6a1760f90ef8a0dcae20 I0506 20:12:27.398437 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 19.340036ms to process 1 records I0506 20:12:27.400523 1 tasks_processing.go:74] worker 42 stopped. I0506 20:12:27.400619 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=69d30856b0f59a90ffe135bc5cabfe7a6628aa1af5943a32dd6c1636526d9dca I0506 20:12:27.400642 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=c4f602a70ef3e6a1d61aea898432b9234c759496d9b645f7121b348d3b604670 I0506 20:12:27.400652 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 21.764373ms to process 2 records I0506 20:12:27.400718 1 recorder.go:75] Recording config/proxy with fingerprint=69189165dacc8702988d85212455fc3dca46e08a105337a5733986f5e52cfb45 I0506 20:12:27.400728 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 21.948661ms to process 1 records I0506 20:12:27.400735 1 tasks_processing.go:74] worker 8 stopped. I0506 20:12:27.400805 1 tasks_processing.go:74] worker 14 stopped. I0506 20:12:27.401203 1 recorder.go:75] Recording config/infrastructure with fingerprint=f74eb78ed1b144b19143c7d306643017db7245d1702d935f4e108e8597d18d82 I0506 20:12:27.401214 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 21.909342ms to process 1 records I0506 20:12:27.401309 1 tasks_processing.go:74] worker 37 stopped. I0506 20:12:27.401394 1 recorder.go:75] Recording config/oauth with fingerprint=de08d9a14174b7d84e42f588e862fd3f6111bd7cf3a0576043b73302e3c62c39 I0506 20:12:27.401403 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 21.705386ms to process 1 records I0506 20:12:27.401493 1 tasks_processing.go:74] worker 52 stopped. I0506 20:12:27.401793 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=c719e381a814a3d281d2455a3c738593c075ea415eabd4abe7eef906cae75a70 I0506 20:12:27.401803 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 22.134261ms to process 1 records I0506 20:12:27.406067 1 tasks_processing.go:74] worker 45 stopped. I0506 20:12:27.406218 1 recorder.go:75] Recording config/apiserver with fingerprint=deea09b8e9b5cd061ffcbe41d206e5a134cee370384c152c9f3e77b50e75bd94 I0506 20:12:27.406251 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 26.553225ms to process 1 records E0506 20:12:27.406264 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0506 20:12:27.406272 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 25.977798ms to process 0 records I0506 20:12:27.406290 1 tasks_processing.go:74] worker 49 stopped. I0506 20:12:27.406344 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=a02bd715a3e74f5fc75dd8c05258c888236e0298ce7583530a13843856393797 I0506 20:12:27.406355 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 27.209582ms to process 1 records I0506 20:12:27.406364 1 tasks_processing.go:74] worker 22 stopped. I0506 20:12:27.406418 1 recorder.go:75] Recording config/image with fingerprint=35b49a1326c0a852d688d5606bc6cd766d2a4f3e517477f16810d371ead77ee7 I0506 20:12:27.406427 1 gather.go:177] gatherer "clusterconfig" function "image" took 26.472388ms to process 1 records I0506 20:12:27.406432 1 tasks_processing.go:74] worker 59 stopped. I0506 20:12:27.406499 1 tasks_processing.go:74] worker 9 stopped. I0506 20:12:27.406528 1 recorder.go:75] Recording config/network with fingerprint=44c790a38fdcd0b1336769f618b584a41ec23271435acfedab915c786cd40fec I0506 20:12:27.406538 1 gather.go:177] gatherer "clusterconfig" function "networks" took 27.178731ms to process 1 records I0506 20:12:27.407660 1 tasks_processing.go:74] worker 46 stopped. I0506 20:12:27.407670 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 28.803507ms to process 0 records I0506 20:12:27.413804 1 gather_logs.go:145] no pods in namespace were found I0506 20:12:27.413814 1 tasks_processing.go:74] worker 31 stopped. I0506 20:12:27.413821 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 34.06479ms to process 0 records I0506 20:12:27.413828 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 34.282659ms to process 0 records E0506 20:12:27.413833 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0506 20:12:27.413838 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 34.193663ms to process 0 records I0506 20:12:27.413841 1 tasks_processing.go:74] worker 18 stopped. E0506 20:12:27.413843 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0506 20:12:27.413848 1 tasks_processing.go:74] worker 55 stopped. I0506 20:12:27.413849 1 tasks_processing.go:74] worker 25 stopped. I0506 20:12:27.413870 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0506 20:12:27.413885 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 34.531364ms to process 1 records I0506 20:12:27.414124 1 tasks_processing.go:74] worker 62 stopped. I0506 20:12:27.414134 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 33.572899ms to process 0 records I0506 20:12:27.414179 1 tasks_processing.go:74] worker 63 stopped. I0506 20:12:27.414194 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 33.879832ms to process 0 records I0506 20:12:27.415626 1 tasks_processing.go:74] worker 54 stopped. I0506 20:12:27.415653 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0506 20:12:27.415666 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 35.6739ms to process 1 records I0506 20:12:27.423239 1 tasks_processing.go:74] worker 53 stopped. I0506 20:12:27.423253 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 42.727195ms to process 0 records I0506 20:12:27.431217 1 tasks_processing.go:74] worker 23 stopped. I0506 20:12:27.431250 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 50.8814ms to process 0 records I0506 20:12:27.431271 1 tasks_processing.go:74] worker 34 stopped. I0506 20:12:27.431394 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=848bd81e1ce896b9b3bf6562c2161f87a27836e2f8522f22ae0b935b7f96f03c I0506 20:12:27.431430 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=c06186230c7ba185fd9c39ac9b333408a717afdf25b19f0e8193f5747f2b835e I0506 20:12:27.431451 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=138adcfbde8494a48f89f1f6d1e41c03e8dd7cd14cee5cef38bbff57ad59e279 I0506 20:12:27.431458 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 50.876394ms to process 3 records I0506 20:12:27.431588 1 recorder.go:75] Recording config/featuregate with fingerprint=9c0123b5d3cf5e4108cb1c4f9c1b086ae45b465136daecfbc00f4fc037b27663 I0506 20:12:27.431604 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 51.615666ms to process 1 records I0506 20:12:27.431587 1 tasks_processing.go:74] worker 47 stopped. I0506 20:12:27.431674 1 tasks_processing.go:74] worker 7 stopped. I0506 20:12:27.431938 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=d1ea850c60654b8f790b34570f4dcecffc9750c3094577500b3fc6a055095e1a I0506 20:12:27.432003 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=b321424d7e4d70d72265440fce13323029a2c715487b1d99bed473ced3fa2b78 I0506 20:12:27.432059 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=b20f11bc2222e3f462fcbd46572478f26f477ca8f9c8c36b2fd19af4766d80c0 I0506 20:12:27.432072 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 51.740652ms to process 3 records I0506 20:12:27.432145 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=ed96a15d573808bdf6abddc0ef00bef192d177740252e1188583f35e0876c01b I0506 20:12:27.432158 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 52.480701ms to process 1 records I0506 20:12:27.432166 1 tasks_processing.go:74] worker 41 stopped. I0506 20:12:27.432181 1 tasks_processing.go:74] worker 43 stopped. I0506 20:12:27.432206 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 52.414523ms to process 0 records I0506 20:12:27.432213 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 52.935139ms to process 0 records I0506 20:12:27.432219 1 tasks_processing.go:74] worker 17 stopped. I0506 20:12:27.432250 1 tasks_processing.go:74] worker 61 stopped. I0506 20:12:27.432426 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0506 20:12:27.432506 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0506 20:12:27.432524 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=e93b1fdd5bd452a1e1726c1caa286f24bd98fa73051705ea89ed893a8b877a38 W0506 20:12:27.432534 1 operator.go:328] started I0506 20:12:27.432548 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0506 20:12:27.432677 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=5bfa5157cc63f3c7c420671cadbefa8236b2e1f39461add260f25c65c59ae252 I0506 20:12:27.432693 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 52.935219ms to process 2 records I0506 20:12:27.432838 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=089a3236d73a17dac5f67d21fb3f3c39fd0c5cb9cb0aa35ecb75b86c3cfd63ae I0506 20:12:27.432855 1 tasks_processing.go:74] worker 1 stopped. I0506 20:12:27.432963 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=2de2f0276ecf8ea7503b5dbbcf9d6c17b90e454c57284b4c811b51402c101012 I0506 20:12:27.432994 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=73b3bca73f3f2228a553b4d30604a25f8d42cd857207f4ed5c314cba3ed3b905 I0506 20:12:27.433408 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=81f4eb4b55dab32b511963ff793a792112d1cb653451169ccfedc89f2717483e I0506 20:12:27.433465 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=35397c01e80f66cb1ef0b03d508861ba7c2a8b9c54288bdfbb070d37ac9f9594 I0506 20:12:27.433523 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=03739ac3eceec2c89480b027e82f836883072540b7a51670c59d215b1a3f188e I0506 20:12:27.433575 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=efdf7210a5128ade73e4b506cf086806b49b57001f08042a3ad07e526ba8c7e8 I0506 20:12:27.433638 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=3822829c78edd8d0d19dc06434dc5b4b6900cb44ed0673a88dc7222ab187a649 I0506 20:12:27.433689 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=9e3819fb0066db1a10e5658fe398a7c46e06d315f98db3b1768f68a1e223fe00 I0506 20:12:27.433746 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=74ea7570be895c6ea83e9836785a90d353453f98da4de5c12bb3fc782c12f05f I0506 20:12:27.433800 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=efca2b0f3d51f36f4e9a4aef10443b5f259ae2540cb0229aeef8e41eae0baed8 I0506 20:12:27.433811 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 53.729846ms to process 11 records I0506 20:12:27.433907 1 tasks_processing.go:74] worker 44 stopped. I0506 20:12:27.434283 1 recorder.go:75] Recording config/node/ip-10-0-0-68.ec2.internal with fingerprint=f45891c126f51413cbb04e642381da57c8b8ffc78f840368c68d9621c51933c8 I0506 20:12:27.434396 1 recorder.go:75] Recording config/node/ip-10-0-1-72.ec2.internal with fingerprint=194e3f95e8c24b4cf87031e474c52e772c1582a295c8629f89c3d8f3098bc2b9 I0506 20:12:27.434483 1 recorder.go:75] Recording config/node/ip-10-0-2-128.ec2.internal with fingerprint=4ff8f9a5678c3271ac48b1b47989d508596b684313e46ce3706e13dee5f533b2 I0506 20:12:27.434494 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 53.277029ms to process 3 records I0506 20:12:27.434512 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 53.974558ms to process 0 records I0506 20:12:27.434525 1 tasks_processing.go:74] worker 50 stopped. I0506 20:12:27.435949 1 tasks_processing.go:74] worker 58 stopped. I0506 20:12:27.436020 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 56.553594ms to process 0 records W0506 20:12:27.437492 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 20:12:27.441805 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0506 20:12:27.441841 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0506 20:12:27.441888 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0506 20:12:27.442392 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0506 20:12:27.442407 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0506 20:12:27.442411 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0506 20:12:27.442416 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0506 20:12:27.442420 1 controller.go:254] Source scaController *sca.Controller is not ready I0506 20:12:27.442454 1 controller.go:531] The operator is still being initialized I0506 20:12:27.442464 1 controller.go:554] The operator is healthy I0506 20:12:27.442604 1 tasks_processing.go:74] worker 19 stopped. I0506 20:12:27.443502 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=7d55851c9d21b5131614c7b03814e2cd770635ffb279838eaebc36c23421748c I0506 20:12:27.443899 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=fc90722b0a67c008a746f596f884f616791a9f106488e517c4d3f3cb4150e3e6 I0506 20:12:27.443918 1 gather.go:177] gatherer "clusterconfig" function "crds" took 62.275754ms to process 2 records I0506 20:12:27.446808 1 base_controller.go:82] Caches are synced for ConfigController I0506 20:12:27.446833 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0506 20:12:27.448323 1 prometheus_rules.go:88] Prometheus rules successfully created I0506 20:12:27.449720 1 tasks_processing.go:74] worker 4 stopped. I0506 20:12:27.449788 1 recorder.go:75] Recording config/running_containers with fingerprint=b430d9efbc72f888fb57b4ec81058f692726de648adda603f56484a02282c4e2 I0506 20:12:27.449800 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 70.938886ms to process 1 records I0506 20:12:27.451366 1 tasks_processing.go:74] worker 15 stopped. I0506 20:12:27.451378 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 71.680677ms to process 0 records I0506 20:12:27.451444 1 configmapobserver.go:84] configmaps "insights-config" not found E0506 20:12:27.451540 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%277a68cf17-3b5d-4893-bdcb-cbc581925a00%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:51316->172.30.0.10:53: read: connection refused I0506 20:12:27.451550 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%277a68cf17-3b5d-4893-bdcb-cbc581925a00%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:51316->172.30.0.10:53: read: connection refused I0506 20:12:27.454680 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0506 20:12:27.458109 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:53558->172.30.0.10:53: read: connection refused I0506 20:12:27.458122 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:53558->172.30.0.10:53: read: connection refused I0506 20:12:27.459635 1 tasks_processing.go:74] worker 10 stopped. E0506 20:12:27.459648 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0506 20:12:27.459653 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0506 20:12:27.459657 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0506 20:12:27.459665 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0506 20:12:27.459697 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0506 20:12:27.459703 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0506 20:12:27.459707 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0506 20:12:27.459711 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0506 20:12:27.459747 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0506 20:12:27.459753 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0506 20:12:27.459758 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 80.613354ms to process 7 records I0506 20:12:27.513079 1 tasks_processing.go:74] worker 35 stopped. I0506 20:12:27.513323 1 recorder.go:75] Recording config/version with fingerprint=05f85fc2706c847bbbc43557ad60bc6fb1d1309bc173b0a582d826a0ff987691 I0506 20:12:27.513340 1 recorder.go:75] Recording config/id with fingerprint=5eaf22c99d921b7b6f1cdc80134ea5008b44b9cd911a44555a4e3a11d00bb7a7 I0506 20:12:27.513346 1 gather.go:177] gatherer "clusterconfig" function "version" took 133.044943ms to process 2 records I0506 20:12:27.533453 1 base_controller.go:82] Caches are synced for LoggingSyncer I0506 20:12:27.533469 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0506 20:12:27.535535 1 tasks_processing.go:74] worker 32 stopped. E0506 20:12:27.535553 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0506 20:12:27.535562 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q4kp77oipug2hvvh6d7vlnhnie88jkr-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q4kp77oipug2hvvh6d7vlnhnie88jkr-primary-cert-bundle-secret" not found I0506 20:12:27.535624 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=1a2307508db718ffedae2e5b52aeb023df77469fce7def0fccd65f3bec241cd7 I0506 20:12:27.535642 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 156.5641ms to process 1 records I0506 20:12:27.843494 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0506 20:12:27.843509 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0506 20:12:27.844271 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-9tgv5 pod in namespace openshift-dns (previous: false). I0506 20:12:28.048757 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-9tgv5 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-9tgv5\" is waiting to start: ContainerCreating" I0506 20:12:28.048774 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-9tgv5\" is waiting to start: ContainerCreating" I0506 20:12:28.048781 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-9tgv5 pod in namespace openshift-dns (previous: false). I0506 20:12:28.249078 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-9tgv5 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-9tgv5\" is waiting to start: ContainerCreating" I0506 20:12:28.249095 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-9tgv5\" is waiting to start: ContainerCreating" I0506 20:12:28.249105 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-n2dq2 pod in namespace openshift-dns (previous: false). W0506 20:12:28.435926 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 20:12:28.448355 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-n2dq2 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-n2dq2\" is waiting to start: ContainerCreating" I0506 20:12:28.448372 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-n2dq2\" is waiting to start: ContainerCreating" I0506 20:12:28.448379 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-n2dq2 pod in namespace openshift-dns (previous: false). I0506 20:12:28.648380 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-n2dq2 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-n2dq2\" is waiting to start: ContainerCreating" I0506 20:12:28.648396 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-n2dq2\" is waiting to start: ContainerCreating" I0506 20:12:28.648405 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-xmmk5 pod in namespace openshift-dns (previous: false). I0506 20:12:28.847351 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xmmk5 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-xmmk5\" is waiting to start: ContainerCreating" I0506 20:12:28.847365 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-xmmk5\" is waiting to start: ContainerCreating" I0506 20:12:28.847373 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-xmmk5 pod in namespace openshift-dns (previous: false). I0506 20:12:29.049507 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xmmk5 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-xmmk5\" is waiting to start: ContainerCreating" I0506 20:12:29.049524 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-xmmk5\" is waiting to start: ContainerCreating" I0506 20:12:29.049534 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-88xp8 pod in namespace openshift-dns (previous: false). I0506 20:12:29.055967 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0506 20:12:29.248287 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 20:12:29.248302 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-nd98r pod in namespace openshift-dns (previous: false). W0506 20:12:29.434974 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 20:12:29.448063 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 20:12:29.448078 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-r2pc7 pod in namespace openshift-dns (previous: false). I0506 20:12:29.648634 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 20:12:29.648682 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-56db4b9cb7-p7wx4 pod in namespace openshift-image-registry (previous: false). I0506 20:12:29.658015 1 tasks_processing.go:74] worker 12 stopped. I0506 20:12:29.658086 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=d87d885fb27101ea7770cd89adb74abc584ec4d35908161de9fb3cd94599dc2c I0506 20:12:29.658144 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=d6b73a1cd36a3a14fd8cb693eabf7fed8944aa0f2a85319cbaec9523898bad56 I0506 20:12:29.658183 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0506 20:12:29.658223 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=66c9eee90039afa193da13575f7bcb4cfc114c68a376ab94dc4284d0729a5867 I0506 20:12:29.658261 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0506 20:12:29.658293 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=3762fb2c7e4c2f7094cf87f2e77d223c60275b0aca49916e6b41a494a14d795f I0506 20:12:29.658361 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=83c1ca9bac358c6c4ebb77985ce6155137062b3d18bf3e1beeeca72d7ba2dd50 I0506 20:12:29.658398 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=72f683485e41f4aebc675b35820d1fa05d56e2b94fd5d23076f62340faba40f6 I0506 20:12:29.658442 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=24e1d6411f5751aee7588cd18bb100d6df43c4f390483a816410358adb6b0a39 I0506 20:12:29.658456 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I0506 20:12:29.658488 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=333a7791efe510df9015618dd991c8ea75444449e5bfc5d0ac4127c97ae5d663 I0506 20:12:29.658503 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0506 20:12:29.658530 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=efea43ee92a911018000fb9ad9d4b89b2217aacb247a0cb2a4402abcac489851 I0506 20:12:29.658548 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0506 20:12:29.658574 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=7571550528b23479afe1c574b343c3bc5bff16febefa0f9f76a8b94583cc17cb I0506 20:12:29.658598 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0506 20:12:29.658623 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=04bec18d693d4b5a61ab474c9b79e09f338b0e648635a79cc0f92ee989107b45 I0506 20:12:29.658638 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0506 20:12:29.658663 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=e2e9dcd1ae934d8d1b6b41225af566c5cfe16e4faa708a474fc99cb8457d9134 I0506 20:12:29.658824 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=2df86c218b9cd74edd105ce4248b248bf093acf6e0bf1591bff066c985d5a4a1 I0506 20:12:29.658840 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0506 20:12:29.658852 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0506 20:12:29.658884 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0506 20:12:29.658920 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=5bc2b1e7bf219c9b3e688e4cd4d58cf794426a7b36d918a1d8eda1ca722a3e59 I0506 20:12:29.658958 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=6dd95120b73f8f64962f07f5464ddb5075a5ee773c1adc08e6637d2641438682 I0506 20:12:29.658973 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0506 20:12:29.659000 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=972c93f2de590e9323ccfadc4d11a2f42dece8f1421c72850016cc75ebc59a13 I0506 20:12:29.659014 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0506 20:12:29.659037 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=2651993d4ca37f54ddbf88f692f5a3645598eb0426e5b0374489d4957fc6301a I0506 20:12:29.659061 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=8c83fdc3b29f39479525311d0c468fc837604a668074e0a8b165f2816e867283 I0506 20:12:29.659085 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=9665ecbbb5bd2a4283f5e009c6a695094b4d93a4458dd574cd26957c6b455f00 I0506 20:12:29.659113 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=e514b3b3b75b56f2fec3275b23890550cfb540a734932c379b7663fe89c765bb I0506 20:12:29.659147 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=f3b2da15a4bfe66a588f5e703aa90a924196cb7655cf6576ed7553cc441c4956 I0506 20:12:29.659161 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0506 20:12:29.659201 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=c639f1cf42dd218e47f192cfcd7fc6b578e695850d5f0079255f845c36684253 I0506 20:12:29.659244 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0506 20:12:29.659260 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0506 20:12:29.659270 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.278351983s to process 37 records I0506 20:12:29.847378 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-56db4b9cb7-p7wx4 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-56db4b9cb7-p7wx4\" is waiting to start: ContainerCreating" I0506 20:12:29.847396 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-56db4b9cb7-p7wx4\" is waiting to start: ContainerCreating" I0506 20:12:29.847449 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5ff4746bd4-277p9 pod in namespace openshift-image-registry (previous: false). I0506 20:12:30.048746 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5ff4746bd4-277p9 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5ff4746bd4-277p9\" is waiting to start: ContainerCreating" I0506 20:12:30.048767 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5ff4746bd4-277p9\" is waiting to start: ContainerCreating" I0506 20:12:30.048812 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5ff4746bd4-c9t7p pod in namespace openshift-image-registry (previous: false). I0506 20:12:30.252384 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5ff4746bd4-c9t7p pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5ff4746bd4-c9t7p\" is waiting to start: ContainerCreating" I0506 20:12:30.252404 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5ff4746bd4-c9t7p\" is waiting to start: ContainerCreating" I0506 20:12:30.252415 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-44jld pod in namespace openshift-image-registry (previous: false). W0506 20:12:30.434261 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 20:12:30.447530 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 20:12:30.447545 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-kl46g pod in namespace openshift-image-registry (previous: false). I0506 20:12:30.649089 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 20:12:30.649103 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-m84lg pod in namespace openshift-image-registry (previous: false). I0506 20:12:30.847592 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 20:12:30.847608 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-589cdb776c-zd7zh pod in namespace openshift-ingress (previous: false). I0506 20:12:31.055488 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-589cdb776c-zd7zh pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-589cdb776c-zd7zh\" is waiting to start: ContainerCreating" I0506 20:12:31.055504 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-589cdb776c-zd7zh\" is waiting to start: ContainerCreating" I0506 20:12:31.055518 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-589cdb776c-zlg9x pod in namespace openshift-ingress (previous: false). I0506 20:12:31.249182 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-589cdb776c-zlg9x pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-589cdb776c-zlg9x\" is waiting to start: ContainerCreating" I0506 20:12:31.249196 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-589cdb776c-zlg9x\" is waiting to start: ContainerCreating" I0506 20:12:31.249205 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-77d8b75467-mlqnc pod in namespace openshift-ingress (previous: false). W0506 20:12:31.434708 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 20:12:31.448791 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-77d8b75467-mlqnc pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-77d8b75467-mlqnc\" is waiting to start: ContainerCreating" I0506 20:12:31.448804 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-77d8b75467-mlqnc\" is waiting to start: ContainerCreating" I0506 20:12:31.448812 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-fm4lp pod in namespace openshift-ingress-canary (previous: false). I0506 20:12:31.657032 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-prgv7 pod in namespace openshift-ingress-canary (previous: false). I0506 20:12:31.856739 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-v5vjh pod in namespace openshift-ingress-canary (previous: false). I0506 20:12:32.056456 1 tasks_processing.go:74] worker 20 stopped. I0506 20:12:32.056552 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=ed06e72cb269db94af215224cf6ee702c2fc7228a9fd141c3ff32d6833460cf1 I0506 20:12:32.056610 1 recorder.go:75] Recording events/openshift-dns with fingerprint=ef2a86f442fa9744dda4719475a45834d1af6aec9f6c40742e59e2f7b67d76b9 I0506 20:12:32.056714 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=d303ed4235e12c7e6da982a02a7ecbc6b50b2548de243ab1deef946cc2c4b674 I0506 20:12:32.056741 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=40b859ae23f1b53c3af52dce60a153c075818e768c2397369d19daa3d76bb7f0 I0506 20:12:32.056786 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=4abd21c2a36da5fcf3841aa4700c827fafa25194e552a77ec0b370cf6e1a1f12 I0506 20:12:32.056824 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=95cc7c340767664d4c67a73adf017a78898c90e730f46a1995352ae7d08d0d4a I0506 20:12:32.058208 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-56db4b9cb7-p7wx4 with fingerprint=5e55f50c6492dc36a64e5d3a50454183ba4ba0163d1eca16a6a42fb7f5c00a91 I0506 20:12:32.058336 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5ff4746bd4-277p9 with fingerprint=e22b8f1f9ed8b9b6b0a6660d6ba4fb3eb0478811b6af6ac34c7a9deb7590dbde I0506 20:12:32.058429 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5ff4746bd4-c9t7p with fingerprint=c01678d99158bc3fe43b39f10a4951e86459681cce93fcd5aa70fc21e36682dd I0506 20:12:32.058437 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-fm4lp/serve-healthcheck-canary_current.log with fingerprint=2a5066e0ccecd5a40501a4a9db5aeaa40ac7ab28cce2f795faf739dd7d75a995 I0506 20:12:32.058441 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-prgv7/serve-healthcheck-canary_current.log with fingerprint=960f541edd3e662dc936a9771cf786189f07c894c3bcefa19468799c59e3e920 I0506 20:12:32.058446 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-v5vjh/serve-healthcheck-canary_current.log with fingerprint=aed5ab63b01c8ee1c0d71e01b1f66d99fc3600a19b42568295376db9d94e67ef I0506 20:12:32.058452 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.676385014s to process 12 records W0506 20:12:32.431608 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded E0506 20:12:32.431645 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0506 20:12:32.431657 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0506 20:12:32.431674 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0506 20:12:32.431685 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.052918035s to process 1 records I0506 20:12:32.431631 1 tasks_processing.go:74] worker 3 stopped. I0506 20:12:39.134999 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 20:12:40.020524 1 tasks_processing.go:74] worker 57 stopped. I0506 20:12:40.020565 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0506 20:12:40.020581 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.640369377s to process 1 records I0506 20:12:40.847789 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 20:12:40.987615 1 tasks_processing.go:74] worker 30 stopped. I0506 20:12:40.987898 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=c8ec6b4e3ff562aa9cffb0c6c8a7aad5bc75cfbbdcd0f7c491f6727973a8d911 I0506 20:12:40.987915 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.608836246s to process 1 records E0506 20:12:40.987969 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.609s with: function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0506 20:12:40.989076 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0506 20:12:40.989090 1 periodic.go:216] Running workloads gatherer I0506 20:12:40.989105 1 tasks_processing.go:45] number of workers: 2 I0506 20:12:40.989115 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 20:12:40.989119 1 tasks_processing.go:71] worker 1 working on workload_info task. I0506 20:12:40.989128 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 20:12:40.989149 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0506 20:12:41.019323 1 tasks_processing.go:74] worker 0 stopped. I0506 20:12:41.019341 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.155734ms to process 0 records I0506 20:12:41.045778 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 20:12:41.114415 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0506 20:12:41.124249 1 gather_workloads_info.go:387] No image sha256:3a1c7ec9bb0db343348170a70697ea3209ed81e22f1259ff694190e5d04ef250 (11ms) I0506 20:12:41.135210 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (11ms) I0506 20:12:41.149339 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (14ms) I0506 20:12:41.160172 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (11ms) I0506 20:12:41.174299 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (14ms) I0506 20:12:41.188239 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (14ms) I0506 20:12:41.206794 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (19ms) I0506 20:12:41.218130 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (11ms) I0506 20:12:41.231126 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (13ms) I0506 20:12:41.245209 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (14ms) I0506 20:12:41.258106 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (13ms) I0506 20:12:41.338751 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (81ms) I0506 20:12:41.429051 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (90ms) I0506 20:12:41.524544 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (95ms) I0506 20:12:41.623451 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (99ms) I0506 20:12:41.723461 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (100ms) I0506 20:12:41.823792 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0506 20:12:41.923544 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (100ms) I0506 20:12:42.023700 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (100ms) I0506 20:12:42.124316 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (101ms) I0506 20:12:42.223820 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (99ms) I0506 20:12:42.323263 1 gather_workloads_info.go:387] No image sha256:0092742d8c2f3e9241f8f87d6f1da2a063627c140c491dc9c5e97526f760101a (99ms) I0506 20:12:42.423557 1 gather_workloads_info.go:387] No image sha256:295fdda3bdb8bc5a12a5b038d087001f9e37481cf6f1b3a6d80d39dfabe17af9 (100ms) I0506 20:12:42.523942 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms) I0506 20:12:42.623349 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (99ms) I0506 20:12:42.723722 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms) I0506 20:12:42.823515 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (100ms) I0506 20:12:42.923779 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (100ms) I0506 20:12:43.023170 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (99ms) I0506 20:12:43.127169 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (104ms) I0506 20:12:43.223756 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (97ms) I0506 20:12:43.323101 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (99ms) I0506 20:12:43.423346 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (100ms) I0506 20:12:43.524097 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (101ms) I0506 20:12:43.623542 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (99ms) I0506 20:12:43.723714 1 gather_workloads_info.go:387] No image sha256:b958e39c1643d98648b20ff8b6ec38a51c9c6606f2eecff4044d41ac993e1878 (100ms) I0506 20:12:43.823579 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0506 20:12:43.823610 1 tasks_processing.go:74] worker 1 stopped. E0506 20:12:43.823622 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0506 20:12:43.823886 1 recorder.go:75] Recording config/workload_info with fingerprint=fe95ee0f01bcf25ee7a797157b5bac393461d4bd720c9d146713e5c4015d59ca I0506 20:12:43.823904 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.834484128s to process 1 records E0506 20:12:43.823930 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.834s with: function \"workload_info\" failed with an error" I0506 20:12:43.825041 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0506 20:12:43.825054 1 periodic.go:216] Running conditional gatherer I0506 20:12:43.832025 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0506 20:12:43.839418 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.13:34787->172.30.0.10:53: read: connection refused E0506 20:12:43.839761 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 20:12:43.839825 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0506 20:12:43.845846 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0506 20:12:43.845861 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 20:12:43.845866 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 20:12:43.845869 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 20:12:43.845873 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 20:12:43.845876 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 20:12:43.845879 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 20:12:43.845882 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 20:12:43.845885 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 20:12:43.845888 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0506 20:12:43.845903 1 tasks_processing.go:45] number of workers: 3 I0506 20:12:43.845912 1 tasks_processing.go:69] worker 2 listening for tasks. I0506 20:12:43.845918 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0506 20:12:43.845918 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 20:12:43.845929 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0506 20:12:43.845934 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 20:12:43.845951 1 tasks_processing.go:74] worker 1 stopped. I0506 20:12:43.845937 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0506 20:12:43.846036 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0506 20:12:43.846055 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.268µs to process 1 records I0506 20:12:43.846111 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0506 20:12:43.846122 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 900ns to process 1 records I0506 20:12:43.846130 1 tasks_processing.go:74] worker 0 stopped. I0506 20:12:43.846322 1 tasks_processing.go:74] worker 2 stopped. I0506 20:12:43.846336 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 325.704µs to process 0 records I0506 20:12:43.846357 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.13:34787->172.30.0.10:53: read: connection refused I0506 20:12:43.846375 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0506 20:12:43.869666 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=892a0a168620478f3b96dfb59dee634f61920a76f193325371dc5e323458fa80 I0506 20:12:43.869796 1 diskrecorder.go:70] Writing 107 records to /var/lib/insights-operator/insights-2026-05-06-201243.tar.gz I0506 20:12:43.878265 1 diskrecorder.go:51] Wrote 107 records to disk in 8ms I0506 20:12:43.878300 1 periodic.go:285] Gathering cluster info every 2h0m0s I0506 20:12:43.878316 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0506 20:12:52.162173 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 20:13:57.016285 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="b644b2359e1d0bd64f4e60f950038996188be7e7fb4e76c443036f81e56fc148") W0506 20:13:57.016339 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0506 20:13:57.016385 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="91ee0bb5d10f5ff99fcabc39bfb4f5d1676861e50a488e87de27654b71d433ea") I0506 20:13:57.016477 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"