W0506 02:59:33.516747 1 cmd.go:257] Using insecure, self-signed certificates I0506 02:59:34.097447 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 02:59:34.097789 1 observer_polling.go:159] Starting file observer I0506 02:59:35.203807 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0506 02:59:35.204012 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0506 02:59:35.204514 1 secure_serving.go:57] Forcing use of http/1.1 only W0506 02:59:35.204534 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0506 02:59:35.204538 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0506 02:59:35.204541 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0506 02:59:35.204543 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0506 02:59:35.204546 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0506 02:59:35.204548 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0506 02:59:35.204619 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0506 02:59:35.208229 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0506 02:59:35.208283 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"b87c7db8-e9f0-489e-93c0-3171b6de8c18", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0506 02:59:35.209006 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0506 02:59:35.209017 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0506 02:59:35.209027 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0506 02:59:35.209027 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0506 02:59:35.209038 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0506 02:59:35.209031 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0506 02:59:35.209285 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-117762192/tls.crt::/tmp/serving-cert-117762192/tls.key" I0506 02:59:35.209772 1 secure_serving.go:213] Serving securely on [::]:8443 I0506 02:59:35.209864 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0506 02:59:35.213251 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0506 02:59:35.213278 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0506 02:59:35.213385 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0506 02:59:35.218988 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 02:59:35.219005 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0506 02:59:35.223790 1 secretconfigobserver.go:119] support secret does not exist I0506 02:59:35.228700 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 02:59:35.235331 1 secretconfigobserver.go:119] support secret does not exist I0506 02:59:35.236900 1 recorder.go:176] Pruning old reports every 8h21m11s, max age is 288h0m0s I0506 02:59:35.241483 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0506 02:59:35.241494 1 periodic.go:216] Running clusterconfig gatherer I0506 02:59:35.241504 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0506 02:59:35.241532 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0506 02:59:35.241533 1 tasks_processing.go:45] number of workers: 64 I0506 02:59:35.241541 1 insightsreport.go:296] Starting report retriever I0506 02:59:35.241548 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0506 02:59:35.241558 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 02:59:35.241561 1 tasks_processing.go:69] worker 6 listening for tasks. I0506 02:59:35.241569 1 tasks_processing.go:69] worker 5 listening for tasks. I0506 02:59:35.241572 1 tasks_processing.go:69] worker 4 listening for tasks. I0506 02:59:35.241575 1 tasks_processing.go:69] worker 12 listening for tasks. I0506 02:59:35.241581 1 tasks_processing.go:69] worker 7 listening for tasks. I0506 02:59:35.241585 1 tasks_processing.go:71] worker 12 working on active_alerts task. I0506 02:59:35.241589 1 tasks_processing.go:69] worker 20 listening for tasks. I0506 02:59:35.241592 1 tasks_processing.go:69] worker 8 listening for tasks. I0506 02:59:35.241594 1 tasks_processing.go:69] worker 14 listening for tasks. I0506 02:59:35.241591 1 tasks_processing.go:69] worker 19 listening for tasks. I0506 02:59:35.241603 1 tasks_processing.go:69] worker 9 listening for tasks. I0506 02:59:35.241599 1 tasks_processing.go:69] worker 21 listening for tasks. I0506 02:59:35.241608 1 tasks_processing.go:69] worker 17 listening for tasks. I0506 02:59:35.241610 1 tasks_processing.go:69] worker 18 listening for tasks. I0506 02:59:35.241610 1 tasks_processing.go:69] worker 13 listening for tasks. I0506 02:59:35.241605 1 tasks_processing.go:69] worker 22 listening for tasks. I0506 02:59:35.241620 1 tasks_processing.go:69] worker 11 listening for tasks. I0506 02:59:35.241621 1 tasks_processing.go:69] worker 24 listening for tasks. I0506 02:59:35.241618 1 tasks_processing.go:69] worker 16 listening for tasks. I0506 02:59:35.241627 1 tasks_processing.go:69] worker 3 listening for tasks. I0506 02:59:35.241622 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 02:59:35.241635 1 tasks_processing.go:69] worker 39 listening for tasks. I0506 02:59:35.241631 1 tasks_processing.go:69] worker 2 listening for tasks. I0506 02:59:35.241640 1 tasks_processing.go:69] worker 41 listening for tasks. I0506 02:59:35.241639 1 tasks_processing.go:71] worker 7 working on dvo_metrics task. I0506 02:59:35.241644 1 tasks_processing.go:71] worker 20 working on sap_datahubs task. I0506 02:59:35.241646 1 tasks_processing.go:69] worker 48 listening for tasks. I0506 02:59:35.241670 1 tasks_processing.go:71] worker 41 working on machine_configs task. I0506 02:59:35.241675 1 tasks_processing.go:71] worker 48 working on nodes task. I0506 02:59:35.241676 1 tasks_processing.go:71] worker 14 working on node_logs task. I0506 02:59:35.241677 1 tasks_processing.go:69] worker 32 listening for tasks. I0506 02:59:35.241644 1 tasks_processing.go:71] worker 2 working on machine_autoscalers task. I0506 02:59:35.241677 1 tasks_processing.go:69] worker 29 listening for tasks. I0506 02:59:35.241687 1 tasks_processing.go:69] worker 44 listening for tasks. I0506 02:59:35.241583 1 tasks_processing.go:71] worker 4 working on storage_cluster task. I0506 02:59:35.241699 1 tasks_processing.go:71] worker 19 working on pod_network_connectivity_checks task. I0506 02:59:35.241701 1 tasks_processing.go:69] worker 26 listening for tasks. I0506 02:59:35.241701 1 tasks_processing.go:69] worker 38 listening for tasks. I0506 02:59:35.241702 1 tasks_processing.go:69] worker 28 listening for tasks. I0506 02:59:35.241712 1 tasks_processing.go:69] worker 58 listening for tasks. I0506 02:59:35.241615 1 tasks_processing.go:69] worker 10 listening for tasks. I0506 02:59:35.241710 1 tasks_processing.go:71] worker 9 working on machine_config_pools task. I0506 02:59:35.241718 1 tasks_processing.go:71] worker 21 working on container_runtime_configs task. I0506 02:59:35.241726 1 tasks_processing.go:69] worker 54 listening for tasks. I0506 02:59:35.241730 1 tasks_processing.go:71] worker 10 working on node_features task. I0506 02:59:35.241732 1 tasks_processing.go:71] worker 54 working on openshift_machine_api_events task. I0506 02:59:35.241741 1 tasks_processing.go:69] worker 51 listening for tasks. I0506 02:59:35.241732 1 tasks_processing.go:69] worker 33 listening for tasks. I0506 02:59:35.241750 1 tasks_processing.go:69] worker 52 listening for tasks. I0506 02:59:35.241761 1 tasks_processing.go:69] worker 56 listening for tasks. I0506 02:59:35.241761 1 tasks_processing.go:71] worker 5 working on metrics task. I0506 02:59:35.241770 1 tasks_processing.go:69] worker 59 listening for tasks. I0506 02:59:35.241783 1 tasks_processing.go:69] worker 60 listening for tasks. W0506 02:59:35.241796 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 02:59:35.241823 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 36.512µs to process 0 records I0506 02:59:35.241836 1 tasks_processing.go:69] worker 55 listening for tasks. I0506 02:59:35.241626 1 tasks_processing.go:69] worker 34 listening for tasks. I0506 02:59:35.241627 1 tasks_processing.go:69] worker 45 listening for tasks. I0506 02:59:35.241630 1 tasks_processing.go:69] worker 46 listening for tasks. I0506 02:59:35.241630 1 tasks_processing.go:69] worker 25 listening for tasks. I0506 02:59:35.241636 1 tasks_processing.go:71] worker 3 working on version task. I0506 02:59:35.241614 1 tasks_processing.go:69] worker 23 listening for tasks. I0506 02:59:35.241667 1 tasks_processing.go:71] worker 17 working on openstack_dataplanedeployments task. I0506 02:59:35.241972 1 tasks_processing.go:71] worker 32 working on monitoring_persistent_volumes task. I0506 02:59:35.241988 1 tasks_processing.go:71] worker 38 working on install_plans task. I0506 02:59:35.242014 1 tasks_processing.go:71] worker 29 working on container_images task. I0506 02:59:35.241637 1 tasks_processing.go:69] worker 47 listening for tasks. I0506 02:59:35.241638 1 tasks_processing.go:69] worker 30 listening for tasks. I0506 02:59:35.241643 1 tasks_processing.go:71] worker 39 working on cluster_apiserver task. I0506 02:59:35.242253 1 tasks_processing.go:71] worker 18 working on support_secret task. I0506 02:59:35.242265 1 tasks_processing.go:69] worker 61 listening for tasks. I0506 02:59:35.241645 1 tasks_processing.go:69] worker 35 listening for tasks. I0506 02:59:35.242278 1 tasks_processing.go:71] worker 0 working on machines task. I0506 02:59:35.241645 1 tasks_processing.go:69] worker 31 listening for tasks. I0506 02:59:35.241672 1 tasks_processing.go:71] worker 8 working on openstack_version task. I0506 02:59:35.242285 1 tasks_processing.go:69] worker 57 listening for tasks. I0506 02:59:35.241646 1 tasks_processing.go:69] worker 43 listening for tasks. I0506 02:59:35.241689 1 tasks_processing.go:69] worker 37 listening for tasks. I0506 02:59:35.241688 1 tasks_processing.go:69] worker 27 listening for tasks. I0506 02:59:35.241717 1 tasks_processing.go:69] worker 53 listening for tasks. I0506 02:59:35.241724 1 tasks_processing.go:69] worker 49 listening for tasks. I0506 02:59:35.241964 1 tasks_processing.go:71] worker 26 working on nodenetworkconfigurationpolicies task. I0506 02:59:35.241638 1 tasks_processing.go:71] worker 1 working on overlapping_namespace_uids task. W0506 02:59:35.241615 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 02:59:35.242446 1 tasks_processing.go:71] worker 13 working on oauths task. I0506 02:59:35.242489 1 tasks_processing.go:71] worker 51 working on crds task. I0506 02:59:35.243290 1 tasks_processing.go:71] worker 12 working on qemu_kubevirt_launcher_logs task. I0506 02:59:35.243356 1 tasks_processing.go:71] worker 60 working on tsdb_status task. I0506 02:59:35.241635 1 tasks_processing.go:69] worker 42 listening for tasks. I0506 02:59:35.243896 1 tasks_processing.go:71] worker 49 working on ingress_certificates task. I0506 02:59:35.241586 1 tasks_processing.go:69] worker 15 listening for tasks. I0506 02:59:35.243927 1 tasks_processing.go:71] worker 15 working on networks task. I0506 02:59:35.242458 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 859.289µs to process 0 records I0506 02:59:35.242440 1 tasks_processing.go:71] worker 11 working on authentication task. I0506 02:59:35.243299 1 tasks_processing.go:71] worker 59 working on ceph_cluster task. I0506 02:59:35.242426 1 tasks_processing.go:69] worker 62 listening for tasks. I0506 02:59:35.242458 1 tasks_processing.go:71] worker 44 working on proxies task. I0506 02:59:35.244194 1 tasks_processing.go:71] worker 62 working on pdbs task. I0506 02:59:35.241668 1 tasks_processing.go:69] worker 36 listening for tasks. I0506 02:59:35.242469 1 tasks_processing.go:71] worker 24 working on validating_webhook_configurations task. I0506 02:59:35.242473 1 tasks_processing.go:71] worker 22 working on operators_pods_and_events task. I0506 02:59:35.242479 1 tasks_processing.go:71] worker 6 working on cost_management_metrics_configs task. I0506 02:59:35.242490 1 tasks_processing.go:71] worker 56 working on schedulers task. I0506 02:59:35.241731 1 tasks_processing.go:69] worker 50 listening for tasks. I0506 02:59:35.242557 1 tasks_processing.go:71] worker 47 working on infrastructures task. I0506 02:59:35.243208 1 tasks_processing.go:71] worker 33 working on aggregated_monitoring_cr_names task. I0506 02:59:35.243235 1 tasks_processing.go:71] worker 52 working on sap_config task. W0506 02:59:35.243423 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 02:59:35.244375 1 tasks_processing.go:71] worker 60 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0506 02:59:35.242467 1 tasks_processing.go:71] worker 16 working on config_maps task. I0506 02:59:35.244477 1 tasks_processing.go:71] worker 50 working on machine_sets task. I0506 02:59:35.244570 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 968.981µs to process 0 records I0506 02:59:35.243485 1 tasks_processing.go:71] worker 58 working on openstack_dataplanenodesets task. I0506 02:59:35.243531 1 tasks_processing.go:71] worker 5 working on nodenetworkstates task. I0506 02:59:35.243541 1 tasks_processing.go:71] worker 28 working on image_registries task. I0506 02:59:35.243572 1 tasks_processing.go:71] worker 45 working on operators task. I0506 02:59:35.243593 1 tasks_processing.go:71] worker 57 working on openstack_controlplanes task. I0506 02:59:35.243612 1 tasks_processing.go:71] worker 25 working on jaegers task. I0506 02:59:35.243622 1 tasks_processing.go:71] worker 46 working on ingress task. I0506 02:59:35.243631 1 tasks_processing.go:71] worker 55 working on sap_pods task. I0506 02:59:35.243672 1 tasks_processing.go:71] worker 30 working on olm_operators task. I0506 02:59:35.241636 1 tasks_processing.go:69] worker 40 listening for tasks. I0506 02:59:35.243724 1 tasks_processing.go:71] worker 23 working on openshift_logging task. I0506 02:59:35.243726 1 tasks_processing.go:71] worker 34 working on certificate_signing_requests task. I0506 02:59:35.243766 1 tasks_processing.go:71] worker 27 working on clusterroles task. I0506 02:59:35.243796 1 tasks_processing.go:71] worker 43 working on lokistack task. I0506 02:59:35.243827 1 tasks_processing.go:71] worker 61 working on mutating_webhook_configurations task. I0506 02:59:35.243836 1 tasks_processing.go:71] worker 37 working on feature_gates task. I0506 02:59:35.243843 1 tasks_processing.go:71] worker 31 working on image task. I0506 02:59:35.243849 1 tasks_processing.go:71] worker 53 working on image_pruners task. I0506 02:59:35.243874 1 tasks_processing.go:71] worker 35 working on machine_healthchecks task. I0506 02:59:35.243904 1 tasks_processing.go:71] worker 42 working on storage_classes task. I0506 02:59:35.244268 1 tasks_processing.go:71] worker 36 working on service_accounts task. I0506 02:59:35.243479 1 tasks_processing.go:69] worker 63 listening for tasks. I0506 02:59:35.245197 1 tasks_processing.go:74] worker 63 stopped. I0506 02:59:35.246015 1 tasks_processing.go:71] worker 40 working on silenced_alerts task. I0506 02:59:35.246023 1 tasks_processing.go:74] worker 17 stopped. I0506 02:59:35.246037 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 4.040414ms to process 0 records W0506 02:59:35.246043 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 02:59:35.246054 1 tasks_processing.go:74] worker 40 stopped. I0506 02:59:35.246063 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 25.563µs to process 0 records I0506 02:59:35.246072 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 4.352511ms to process 0 records I0506 02:59:35.246079 1 tasks_processing.go:74] worker 4 stopped. I0506 02:59:35.246779 1 tasks_processing.go:74] worker 9 stopped. I0506 02:59:35.246797 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 5.046855ms to process 0 records I0506 02:59:35.246825 1 tasks_processing.go:74] worker 2 stopped. I0506 02:59:35.246849 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 5.13396ms to process 0 records I0506 02:59:35.246856 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 5.168849ms to process 0 records I0506 02:59:35.246860 1 tasks_processing.go:74] worker 20 stopped. I0506 02:59:35.247037 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0506 02:59:35.247054 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0506 02:59:35.247057 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0506 02:59:35.247061 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0506 02:59:35.247075 1 controller.go:531] The operator is still being initialized I0506 02:59:35.247080 1 controller.go:554] The operator is healthy E0506 02:59:35.248199 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0506 02:59:35.248212 1 tasks_processing.go:74] worker 10 stopped. I0506 02:59:35.248224 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 6.471183ms to process 0 records I0506 02:59:35.253818 1 tasks_processing.go:74] worker 21 stopped. I0506 02:59:35.253832 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 12.086842ms to process 0 records I0506 02:59:35.253844 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 11.549428ms to process 0 records I0506 02:59:35.253851 1 tasks_processing.go:74] worker 8 stopped. I0506 02:59:35.253865 1 tasks_processing.go:74] worker 26 stopped. I0506 02:59:35.253876 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 11.553518ms to process 0 records E0506 02:59:35.253887 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0506 02:59:35.253892 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 12.158159ms to process 0 records I0506 02:59:35.253898 1 tasks_processing.go:74] worker 19 stopped. I0506 02:59:35.253976 1 tasks_processing.go:74] worker 0 stopped. E0506 02:59:35.253988 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0506 02:59:35.253995 1 gather.go:177] gatherer "clusterconfig" function "machines" took 11.684912ms to process 0 records I0506 02:59:35.254141 1 tasks_processing.go:74] worker 39 stopped. I0506 02:59:35.254285 1 recorder.go:75] Recording config/apiserver with fingerprint=9422c6b10f1a869bf974da05437039890f96e6691d6ce212ce99fadb76252fcb I0506 02:59:35.254297 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 11.982615ms to process 1 records I0506 02:59:35.254377 1 tasks_processing.go:74] worker 13 stopped. I0506 02:59:35.254453 1 recorder.go:75] Recording config/oauth with fingerprint=9a5c50136d99e4acb6c0a74ba18629d2d7f671b0cd413b5d889b9461ee1dacb3 I0506 02:59:35.254464 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 11.661114ms to process 1 records I0506 02:59:35.266836 1 tasks_processing.go:74] worker 59 stopped. I0506 02:59:35.266849 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 22.777785ms to process 0 records I0506 02:59:35.266855 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 22.312275ms to process 0 records I0506 02:59:35.266862 1 tasks_processing.go:74] worker 50 stopped. I0506 02:59:35.272180 1 tasks_processing.go:74] worker 58 stopped. I0506 02:59:35.272191 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 27.544758ms to process 0 records I0506 02:59:35.272394 1 tasks_processing.go:74] worker 43 stopped. I0506 02:59:35.272404 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 27.612338ms to process 0 records I0506 02:59:35.272414 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 28.068163ms to process 0 records E0506 02:59:35.272421 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0506 02:59:35.272435 1 tasks_processing.go:74] worker 6 stopped. I0506 02:59:35.272450 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0506 02:59:35.272466 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 30.728621ms to process 1 records I0506 02:59:35.272476 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 28.048115ms to process 0 records I0506 02:59:35.272484 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 27.699576ms to process 0 records I0506 02:59:35.272492 1 tasks_processing.go:74] worker 25 stopped. I0506 02:59:35.272498 1 tasks_processing.go:74] worker 41 stopped. I0506 02:59:35.272503 1 tasks_processing.go:74] worker 52 stopped. I0506 02:59:35.272560 1 tasks_processing.go:74] worker 23 stopped. I0506 02:59:35.272568 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 27.65308ms to process 0 records I0506 02:59:35.272586 1 tasks_processing.go:74] worker 14 stopped. I0506 02:59:35.272599 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 30.899737ms to process 0 records I0506 02:59:35.272633 1 gather_logs.go:145] no pods in namespace were found I0506 02:59:35.272645 1 tasks_processing.go:74] worker 12 stopped. I0506 02:59:35.272672 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 29.301282ms to process 0 records I0506 02:59:35.272679 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 27.911309ms to process 0 records I0506 02:59:35.272686 1 tasks_processing.go:74] worker 57 stopped. I0506 02:59:35.272802 1 tasks_processing.go:74] worker 55 stopped. I0506 02:59:35.272816 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 28.034351ms to process 0 records I0506 02:59:35.273179 1 tasks_processing.go:74] worker 15 stopped. I0506 02:59:35.273345 1 recorder.go:75] Recording config/network with fingerprint=735a29748521fd87dbcaf0d6f0b15637763a3c4312feb38b0383bb3b4fa76013 I0506 02:59:35.273366 1 gather.go:177] gatherer "clusterconfig" function "networks" took 29.244722ms to process 1 records I0506 02:59:35.273376 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 31.486768ms to process 0 records I0506 02:59:35.273384 1 tasks_processing.go:74] worker 54 stopped. I0506 02:59:35.273386 1 tasks_processing.go:74] worker 5 stopped. I0506 02:59:35.273399 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 28.676398ms to process 0 records I0506 02:59:35.273467 1 tasks_processing.go:74] worker 62 stopped. I0506 02:59:35.273608 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=165eedaba223c744fb874b4061638e590229630a6a5ba18a422885e124483503 I0506 02:59:35.273638 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=53daedc41e752239ab85cde8a9a0640ee837b000737dc9a4a1fc18fda99a351c I0506 02:59:35.273681 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=04d69296ad5945eeddfcaded98330b34c10fe74be850459d08c962d10a94635a I0506 02:59:35.273693 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 29.185834ms to process 3 records I0506 02:59:35.273766 1 recorder.go:75] Recording config/proxy with fingerprint=609f2642f7442a08fab5a08110510b03912fc56a1c0884e400d57d441cf90d72 I0506 02:59:35.273779 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 29.384797ms to process 1 records I0506 02:59:35.273841 1 tasks_processing.go:74] worker 44 stopped. I0506 02:59:35.273956 1 tasks_processing.go:74] worker 11 stopped. I0506 02:59:35.274008 1 recorder.go:75] Recording config/authentication with fingerprint=aa232e5d53f890075f211e2e37e293f777aa2da2626e95fd10dfbfb69882d876 I0506 02:59:35.274030 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 29.57596ms to process 1 records I0506 02:59:35.274098 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=dd580981b9aca19546a3bc7d071a39756e9657c8b7bae28223318e1638118882 I0506 02:59:35.274126 1 tasks_processing.go:74] worker 56 stopped. I0506 02:59:35.274426 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 29.449938ms to process 1 records I0506 02:59:35.274504 1 tasks_processing.go:74] worker 53 stopped. I0506 02:59:35.274966 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=c2b0445b631f39514972c9338d454b837c94bc7b107f4bd85ffe57ee285e1cb1 I0506 02:59:35.275033 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 28.884706ms to process 1 records E0506 02:59:35.275067 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0506 02:59:35.275095 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 31.836322ms to process 0 records I0506 02:59:35.275171 1 tasks_processing.go:74] worker 18 stopped. I0506 02:59:35.275278 1 recorder.go:75] Recording config/image with fingerprint=23b0c8b3e736fcbf13502f9d9a6ed1048419f309c196ffa5bd92f25c50959877 I0506 02:59:35.275318 1 gather.go:177] gatherer "clusterconfig" function "image" took 29.404924ms to process 1 records I0506 02:59:35.275344 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 32.619701ms to process 0 records I0506 02:59:35.275373 1 tasks_processing.go:74] worker 32 stopped. I0506 02:59:35.275292 1 tasks_processing.go:74] worker 31 stopped. I0506 02:59:35.275407 1 tasks_processing.go:74] worker 35 stopped. E0506 02:59:35.275377 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0506 02:59:35.275429 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 29.549521ms to process 0 records I0506 02:59:35.275518 1 tasks_processing.go:74] worker 42 stopped. I0506 02:59:35.276202 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=8a1ed135e9282c3012be938562ad8e9a4da46abfedd23ccbc7c6fe4b7c8b7b6a I0506 02:59:35.276283 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=a8613548fd4ad0d3ec9201891c5e13f48cc66a3dd7fd978ef3d94cdf4ba1df36 I0506 02:59:35.276299 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 29.597127ms to process 2 records I0506 02:59:35.276770 1 tasks_processing.go:74] worker 37 stopped. I0506 02:59:35.276956 1 recorder.go:75] Recording config/featuregate with fingerprint=6a1de93fa947bf4bbbe5587b721e6688da14f4ce37579e6d511083b86c3c9856 I0506 02:59:35.276991 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 31.856395ms to process 1 records I0506 02:59:35.277196 1 tasks_processing.go:74] worker 24 stopped. I0506 02:59:35.277809 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=31c2f5c15c512e90ba9282750c1f0db71911a5bd6e9004e2fcfdb1c9b2a2b826 I0506 02:59:35.278435 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=003429c38f0bba28539ff37177dd828cd471bdf49b6b5945417f367799dd74f8 I0506 02:59:35.278484 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=0d07c13ff47110d53cfcbc639d589c8ed1b3d8b50093437a21c4ead1ee5ec1c7 I0506 02:59:35.278526 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e3a019d59a56236838a2acc50593847b6dd9214f3f77a763569df0b9df2a8f08 I0506 02:59:35.278568 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=5222a1c6094597a9e1029a232de20cafe21c299ff021fd1bdb96e1445132ad08 I0506 02:59:35.278606 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=e5f790c0bc32d442ab9a467f947d7f490a180cf7ea6fe60dd0f0ec63ae0f8ca5 I0506 02:59:35.278631 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=b2331908933d5243635a267608695fef199518251ff54db75f112620d08b4289 I0506 02:59:35.278684 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=032db8b3e88dc31c15bb915f07e760b33c8b9b8b50a6ba3a7fb86c937711b78a I0506 02:59:35.278713 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=b2cf77061ab69071f033ef120c92f8493858f419cf103da00834c65b8685e480 I0506 02:59:35.278746 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=67ca6b3cd9083e256aff40fbc447a56105ef8bb53d392f9cad1f93bbf2faff78 I0506 02:59:35.278772 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=d2e6c5d3524f917cae6b1e08e8b5884edb7e93b5c0ced8c5a72ec742804b411c I0506 02:59:35.278783 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 32.602227ms to process 11 records I0506 02:59:35.278918 1 recorder.go:75] Recording config/ingress with fingerprint=37d99dfafd465d088e2802681181be0d902ed0209e39d7247121a747faa9842a I0506 02:59:35.278934 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 32.617007ms to process 1 records I0506 02:59:35.278917 1 tasks_processing.go:74] worker 46 stopped. I0506 02:59:35.279008 1 tasks_processing.go:74] worker 47 stopped. W0506 02:59:35.279544 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 02:59:35.279818 1 recorder.go:75] Recording config/infrastructure with fingerprint=07da2c5fb9c67a11fc6716d57f6a67a6d56a4612033ebcbc0a152f188031b858 I0506 02:59:35.279838 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 33.169992ms to process 1 records I0506 02:59:35.279931 1 tasks_processing.go:74] worker 61 stopped. I0506 02:59:35.279990 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=dce602d56023a5c42da65222c579753c3d4db9f1f8a4f15d75c82707ed82b3d0 I0506 02:59:35.280054 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=8883f9da8d8694e339f59de05f32a6249de6061940d46355e112008babb1498a I0506 02:59:35.280099 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=10b01103532edb299df692b34bb6d5c990fd2d816b78b92ba73995f66f6039b2 I0506 02:59:35.280111 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.473015ms to process 3 records I0506 02:59:35.280203 1 tasks_processing.go:74] worker 28 stopped. I0506 02:59:35.280721 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=aad72458fe8dcf77370520ae7a6283c0b31501b74a9a7d86a06d8317fa1256ee I0506 02:59:35.280735 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 33.873752ms to process 1 records I0506 02:59:35.280751 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 35.026114ms to process 0 records I0506 02:59:35.280768 1 tasks_processing.go:74] worker 34 stopped. I0506 02:59:35.281443 1 tasks_processing.go:74] worker 1 stopped. I0506 02:59:35.281472 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0506 02:59:35.281484 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 39.04929ms to process 1 records I0506 02:59:35.288663 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0506 02:59:35.288687 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0506 02:59:35.288815 1 operator.go:328] started I0506 02:59:35.288853 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0506 02:59:35.288860 1 tasks_processing.go:74] worker 51 stopped. I0506 02:59:35.289640 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=9175e374dcc1323fc8ea42b0fbe5e3b7f5e55b2493d995980bf54bd924b8d3c3 I0506 02:59:35.289860 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=6793eee5550db705ddb66bfb5e89dc2c808b0edb55b7acf7ae3ff2ae9a735cd5 I0506 02:59:35.289871 1 gather.go:177] gatherer "clusterconfig" function "crds" took 45.603179ms to process 2 records I0506 02:59:35.289954 1 tasks_processing.go:74] worker 27 stopped. I0506 02:59:35.290000 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=a442d305352e2465477758667e8d74ad6f0c8e8591e6c5ac1733f696a2b7d635 I0506 02:59:35.290076 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=2ecb474b2f0e9a76bb2a33dbd12cc36a97ff1bb5df915c4c73b2792d292d3d20 I0506 02:59:35.290084 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 44.093175ms to process 2 records I0506 02:59:35.309061 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0506 02:59:35.309082 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0506 02:59:35.309083 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0506 02:59:35.309442 1 tasks_processing.go:74] worker 33 stopped. I0506 02:59:35.309456 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 65.040941ms to process 0 records I0506 02:59:35.309499 1 tasks_processing.go:74] worker 30 stopped. I0506 02:59:35.309559 1 recorder.go:75] Recording config/olm_operators with fingerprint=037b98911abb6d789bf125e6221a96301634529472ac93f11f1c63a6ac9f3ae7 I0506 02:59:35.309574 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 64.582127ms to process 1 records I0506 02:59:35.313481 1 base_controller.go:82] Caches are synced for ConfigController I0506 02:59:35.313501 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0506 02:59:35.315106 1 tasks_processing.go:74] worker 29 stopped. I0506 02:59:35.316277 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-4q5l5 with fingerprint=51eda186db29b298df179e5768e5d3d748809254d860023379fb5ad70742cb39 I0506 02:59:35.316328 1 recorder.go:75] Recording config/running_containers with fingerprint=4f83ba83e4f845414ba69784f5bf7bef8f42e42a240249e0f377b2acdcab17b9 I0506 02:59:35.316337 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 73.063691ms to process 2 records I0506 02:59:35.323905 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 02:59:35.332768 1 prometheus_rules.go:88] Prometheus rules successfully created I0506 02:59:35.332931 1 tasks_processing.go:74] worker 60 stopped. I0506 02:59:35.332954 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 88.546176ms to process 0 records I0506 02:59:35.333183 1 controller.go:254] Source scaController *sca.Controller is not ready I0506 02:59:35.333192 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0506 02:59:35.333195 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0506 02:59:35.333198 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0506 02:59:35.333201 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0506 02:59:35.333240 1 controller.go:531] The operator is still being initialized I0506 02:59:35.333248 1 controller.go:554] The operator is healthy E0506 02:59:35.340901 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27ba0e92ed-e2d3-4a20-b31d-a9a4202ff6f9%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:58841->172.30.0.10:53: read: connection refused I0506 02:59:35.340915 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27ba0e92ed-e2d3-4a20-b31d-a9a4202ff6f9%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:58841->172.30.0.10:53: read: connection refused I0506 02:59:35.342613 1 tasks_processing.go:74] worker 16 stopped. E0506 02:59:35.342626 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0506 02:59:35.342631 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0506 02:59:35.342634 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0506 02:59:35.342643 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0506 02:59:35.342698 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0506 02:59:35.342706 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0506 02:59:35.342710 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0506 02:59:35.342713 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0506 02:59:35.342749 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0506 02:59:35.342756 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0506 02:59:35.342761 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 98.170268ms to process 7 records I0506 02:59:35.344203 1 tasks_processing.go:74] worker 49 stopped. E0506 02:59:35.344217 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0506 02:59:35.344222 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q45p2d0itqef4rvm2res9khfnao9rof-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q45p2d0itqef4rvm2res9khfnao9rof-primary-cert-bundle-secret" not found I0506 02:59:35.344264 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=46ec0d9c2078533bef3566aba328f5f2aecd6970a99c68f56db5f0e9dcdeeedf I0506 02:59:35.344274 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 100.282808ms to process 1 records I0506 02:59:35.352277 1 tasks_processing.go:74] worker 48 stopped. I0506 02:59:35.352522 1 recorder.go:75] Recording config/node/ip-10-0-0-218.ec2.internal with fingerprint=c076772233ee9b048c4d0fa114eb859d8d39fad3252c8acdfbaba8bdcfdfd539 I0506 02:59:35.352576 1 recorder.go:75] Recording config/node/ip-10-0-1-29.ec2.internal with fingerprint=4287b54f447f503c813ffa5a9060591c509c35c11af103665e7b1b8a61bde2e9 I0506 02:59:35.352624 1 recorder.go:75] Recording config/node/ip-10-0-2-72.ec2.internal with fingerprint=3af7f28c152348990a7f888ac8be56cf542126fef9fa6530f0e64badda921f9b I0506 02:59:35.352634 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 110.589391ms to process 3 records I0506 02:59:35.362181 1 tasks_processing.go:74] worker 3 stopped. I0506 02:59:35.362421 1 recorder.go:75] Recording config/version with fingerprint=a2d7aa1b93d89e0e2ee4d56ac2eaf7d4b3597fa63196e92f97b0b4874b8031f3 I0506 02:59:35.362439 1 recorder.go:75] Recording config/id with fingerprint=fa9354697f6b1874a115ba89a19598795a78daeb791e69a86dc51310517132db I0506 02:59:35.362446 1 gather.go:177] gatherer "clusterconfig" function "version" took 120.321227ms to process 2 records I0506 02:59:35.364049 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0506 02:59:35.367302 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:49072->172.30.0.10:53: read: connection refused I0506 02:59:35.367314 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:49072->172.30.0.10:53: read: connection refused I0506 02:59:35.389262 1 base_controller.go:82] Caches are synced for LoggingSyncer I0506 02:59:35.389273 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... W0506 02:59:36.277878 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 02:59:36.486140 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0506 02:59:36.486158 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0506 02:59:36.486853 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-dqhtt pod in namespace openshift-dns (previous: false). I0506 02:59:36.694604 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dqhtt pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-dqhtt\" is waiting to start: ContainerCreating" I0506 02:59:36.694624 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-dqhtt\" is waiting to start: ContainerCreating" I0506 02:59:36.694632 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-dqhtt pod in namespace openshift-dns (previous: false). I0506 02:59:36.744127 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0506 02:59:36.891327 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dqhtt pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-dqhtt\" is waiting to start: ContainerCreating" I0506 02:59:36.891347 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-dqhtt\" is waiting to start: ContainerCreating" I0506 02:59:36.891358 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-mdxqh pod in namespace openshift-dns (previous: false). I0506 02:59:37.118849 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mdxqh pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-mdxqh\" is waiting to start: ContainerCreating" I0506 02:59:37.118867 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-mdxqh\" is waiting to start: ContainerCreating" I0506 02:59:37.118876 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-mdxqh pod in namespace openshift-dns (previous: false). W0506 02:59:37.277028 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 02:59:37.292098 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mdxqh pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-mdxqh\" is waiting to start: ContainerCreating" I0506 02:59:37.292112 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-mdxqh\" is waiting to start: ContainerCreating" I0506 02:59:37.292123 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-xdd82 pod in namespace openshift-dns (previous: false). I0506 02:59:37.346467 1 tasks_processing.go:74] worker 45 stopped. I0506 02:59:37.346518 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=26aecc30e20aa071f1cad1108d9954364cd70a2fd06b588e8662cd8c3971e166 I0506 02:59:37.346563 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=37bb60e2693da9d888eacdd5cba0a8510328af3fec7ef60b04dbf1ebc47df97a I0506 02:59:37.346592 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0506 02:59:37.346618 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=35b358b1e47cc034b3bf5103e7fdce5c540e4025df87230e41d0b54f20c529a3 I0506 02:59:37.346670 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0506 02:59:37.346694 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=dab7dd11513bd953115aca1e4e14fbab14c31a85585a96f6056ed50c96fab431 I0506 02:59:37.346724 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=dfbee530e6dbd0f1bc92bd5dd0fc75dafeb29c46e5f8dfada5e1f77d4ec3d3ae I0506 02:59:37.346755 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=e98c24b5090f5a4818c2e8af1c754d7a0149dc900f0eff1b192abfb18ab7a9a2 I0506 02:59:37.346770 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=91a2e42e80b840898225e1390bcb6ae7451b8616a7e91ff549c06f61cbace317 I0506 02:59:37.346786 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=26f2f81abc0e0563f75c7f3729a3e822aaf1e40c3d19a0848d1830bf6acf2996 I0506 02:59:37.346795 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0506 02:59:37.346810 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=7f3a7daad85d71b3855ab2eef05c452ebd4abad24252134b333b927338db948a I0506 02:59:37.346819 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0506 02:59:37.346833 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=ed5bb64fa1fc9c5146beaa837ae58c13b863d30d3912d5762cc191e8f7bef514 I0506 02:59:37.346842 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0506 02:59:37.346861 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=318fe74ad4f645c4ea954c953b596de02a19cc1ef6e3b221fc39aa052e02a9e8 I0506 02:59:37.346870 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0506 02:59:37.346885 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=3c3a4fa14ac88634c5a16005c5a6380a9cc6cac67502a9e29948fa4c15463ebb I0506 02:59:37.347003 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=00f3746493d1ab2912a7ef7ae0600cbca7936e0fdf0013c0c7fbeecc32f09d16 I0506 02:59:37.347013 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0506 02:59:37.347021 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0506 02:59:37.347042 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0506 02:59:37.347063 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=c0dd88af6d863c8f4f839d14bfe6bcfd1a39c9464ca3ca38aa2b63d8fe9cd5ee I0506 02:59:37.347085 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=2bb80178efdf7ad008c3b811eacc5c699e8f086726d376e2f4d9da3625c4540b I0506 02:59:37.347095 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0506 02:59:37.347109 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=a1d2c48ccc55089cb89d74097db7234780c3ab7c379eb1b282459768833cbde9 I0506 02:59:37.347116 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0506 02:59:37.347128 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=ae12b8b55a5a6d733c7b06130121ae7fbdd345d47910b1abab334f40a989b83b I0506 02:59:37.347142 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=116fe6b251440fe2776d3759320d5fe80623201d18a3c0f0467354673c425a61 I0506 02:59:37.347154 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=f0ef5b345ce7bc4c37cb15fe0d5f9371e20ad5cac12cba2803dfce53201176d1 I0506 02:59:37.347168 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=72c3a7e0d585cc67c5ac60eb06e5b514af07049dfdd6145fca73e2f7e15af58e I0506 02:59:37.347186 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=385efb595e15fc5e1f87f9cd37629e3849bf450a0537fe27863e78df1a28ba03 I0506 02:59:37.347197 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0506 02:59:37.347221 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=368b53ab358120a8a8938ee5fc4ff8078e2351a9c62a4fe1721cfa927a51c65c I0506 02:59:37.347237 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0506 02:59:37.347244 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0506 02:59:37.347250 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.101703281s to process 36 records I0506 02:59:37.513840 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xdd82 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-xdd82\" is waiting to start: ContainerCreating" I0506 02:59:37.513856 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-xdd82\" is waiting to start: ContainerCreating" I0506 02:59:37.513863 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-xdd82 pod in namespace openshift-dns (previous: false). I0506 02:59:37.692080 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xdd82 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-xdd82\" is waiting to start: ContainerCreating" I0506 02:59:37.692097 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-xdd82\" is waiting to start: ContainerCreating" I0506 02:59:37.692106 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-5wk9r pod in namespace openshift-dns (previous: false). I0506 02:59:37.891514 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 02:59:37.891534 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-mjcj8 pod in namespace openshift-dns (previous: false). I0506 02:59:38.094841 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 02:59:38.094858 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vw4hv pod in namespace openshift-dns (previous: false). W0506 02:59:38.276558 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 02:59:38.292126 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 02:59:38.292173 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5777db76fb-m29mh pod in namespace openshift-image-registry (previous: false). I0506 02:59:38.492128 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5777db76fb-m29mh pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5777db76fb-m29mh\" is waiting to start: ContainerCreating" I0506 02:59:38.492148 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5777db76fb-m29mh\" is waiting to start: ContainerCreating" I0506 02:59:38.492193 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5777db76fb-vjm28 pod in namespace openshift-image-registry (previous: false). I0506 02:59:38.695944 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5777db76fb-vjm28 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5777db76fb-vjm28\" is waiting to start: ContainerCreating" I0506 02:59:38.695963 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5777db76fb-vjm28\" is waiting to start: ContainerCreating" I0506 02:59:38.696021 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6dd6f4f69f-qxclh pod in namespace openshift-image-registry (previous: false). I0506 02:59:38.891823 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6dd6f4f69f-qxclh pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6dd6f4f69f-qxclh\" is waiting to start: ContainerCreating" I0506 02:59:38.891841 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6dd6f4f69f-qxclh\" is waiting to start: ContainerCreating" I0506 02:59:38.891852 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-bw4hw pod in namespace openshift-image-registry (previous: false). I0506 02:59:39.092764 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 02:59:39.092782 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-dg92g pod in namespace openshift-image-registry (previous: false). W0506 02:59:39.276325 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 02:59:39.293617 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 02:59:39.293632 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-lxfhz pod in namespace openshift-image-registry (previous: false). I0506 02:59:39.491114 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 02:59:39.491131 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-65dff8d949-sqrwg pod in namespace openshift-ingress (previous: false). I0506 02:59:39.691725 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-65dff8d949-sqrwg pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-65dff8d949-sqrwg\" is waiting to start: ContainerCreating" I0506 02:59:39.691742 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-65dff8d949-sqrwg\" is waiting to start: ContainerCreating" I0506 02:59:39.691753 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-65dff8d949-vsqjf pod in namespace openshift-ingress (previous: false). I0506 02:59:39.892718 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-65dff8d949-vsqjf pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-65dff8d949-vsqjf\" is waiting to start: ContainerCreating" I0506 02:59:39.892735 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-65dff8d949-vsqjf\" is waiting to start: ContainerCreating" I0506 02:59:39.892745 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6844888fc7-k8t9f pod in namespace openshift-ingress (previous: false). I0506 02:59:40.092194 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6844888fc7-k8t9f pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6844888fc7-k8t9f\" is waiting to start: ContainerCreating" I0506 02:59:40.092210 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6844888fc7-k8t9f\" is waiting to start: ContainerCreating" I0506 02:59:40.092222 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-skttm pod in namespace openshift-ingress-canary (previous: false). W0506 02:59:40.276945 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0506 02:59:40.276967 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0506 02:59:40.276981 1 tasks_processing.go:74] worker 7 stopped. E0506 02:59:40.276990 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0506 02:59:40.277002 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0506 02:59:40.277016 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0506 02:59:40.277027 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.035327738s to process 1 records I0506 02:59:40.292584 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-sp5z4 pod in namespace openshift-ingress-canary (previous: false). I0506 02:59:40.492754 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-szcrv pod in namespace openshift-ingress-canary (previous: false). I0506 02:59:40.691378 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-r5n62 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0506 02:59:40.892122 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-r5n62 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0506 02:59:41.091665 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-6h6gq pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0506 02:59:41.294872 1 tasks_processing.go:74] worker 22 stopped. I0506 02:59:41.294969 1 recorder.go:75] Recording events/openshift-dns with fingerprint=3e93e7f9062f39a1341272666572161856031d17fe772ef8f7ce7d81f27bdf67 I0506 02:59:41.295054 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=c10d44328ba56e84dd98e356f8b183411c10d9f3af9c66ce720ed8d3055dd96d I0506 02:59:41.295084 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=46c58dd14bfb02ec655a256bfbd62b3aa033fcbf64252cace70fee86eb256ab4 I0506 02:59:41.295129 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=16b78f8aa34b90a38b731f9de263b6426477fb99ab8423cccf7c9e56d5e33b60 I0506 02:59:41.295166 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=398f747eef212835d5be1ea1e85f82184da7357c89964a85e6350aa9088be319 I0506 02:59:41.295180 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=be39f47f24496e5f32f96b6b2028ca3de1ac15e1f159798e432b17ce16794a90 I0506 02:59:41.295225 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=c9fbcba791bbc00fecab9145a90e5ea136f822b71bc87837879713d7a676a289 I0506 02:59:41.295378 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5777db76fb-m29mh with fingerprint=42312d7ed9f84224e8ed46cd4e9547b95917b9fb17017ef93ec4afbddf376a29 I0506 02:59:41.295490 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5777db76fb-vjm28 with fingerprint=974735ea4705a5e02f4bcb2fd0b6ce86a979678dcec2ff5b609da11f215552f2 I0506 02:59:41.295577 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6dd6f4f69f-qxclh with fingerprint=2bd472ad5b648344fe950a0004cde9c59809a2e05ba3ec3204442f58682a1461 I0506 02:59:41.295585 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-skttm/serve-healthcheck-canary_current.log with fingerprint=85e68d93625543f8928a9e954d957a5f920f44b0aa2291a119ca6b588d836109 I0506 02:59:41.295589 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-sp5z4/serve-healthcheck-canary_current.log with fingerprint=8680d69d45cf9dd49d6d34b2aa1ea19d7ef5f22ccccccece244937552e5ed148 I0506 02:59:41.295593 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-szcrv/serve-healthcheck-canary_current.log with fingerprint=d6c8ae10fb87653dbb4e3afab6899c0d017c6321b6b61ea723d9cde1a363c1d6 I0506 02:59:41.295606 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-r5n62/migrator_current.log with fingerprint=a627961f1fdad4b60a37d72e25ddd668ffecfd7a1fdfd5d9c71c1728e926eda6 I0506 02:59:41.295612 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-r5n62/graceful-termination_current.log with fingerprint=919f8fbe5b1314dcbf7493bdb9e03d2b42c21a76a3835d64df61fa8d5f5603a4 I0506 02:59:41.295688 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-6h6gq/kube-storage-version-migrator-operator_current.log with fingerprint=8c4ae26504fdc2947c5d2ef9a1915e209b626472935a60416549fd12341bca9f I0506 02:59:41.295698 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.050554388s to process 16 records I0506 02:59:47.619445 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 02:59:47.712994 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 02:59:47.889411 1 tasks_processing.go:74] worker 38 stopped. I0506 02:59:47.889456 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0506 02:59:47.889474 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.647401562s to process 1 records I0506 02:59:47.913290 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 02:59:48.652356 1 tasks_processing.go:74] worker 36 stopped. I0506 02:59:48.652612 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=3e53b89f6756c9efce852af779b96044df71c8b9a8848e3e9c62d0a82e8923ef I0506 02:59:48.652630 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.407246844s to process 1 records E0506 02:59:48.652719 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.411s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0506 02:59:48.653829 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0506 02:59:48.653846 1 periodic.go:216] Running workloads gatherer I0506 02:59:48.653864 1 tasks_processing.go:45] number of workers: 2 I0506 02:59:48.653873 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 02:59:48.653877 1 tasks_processing.go:71] worker 1 working on workload_info task. I0506 02:59:48.653885 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 02:59:48.653902 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0506 02:59:48.683330 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0506 02:59:48.683594 1 tasks_processing.go:74] worker 0 stopped. I0506 02:59:48.683606 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 29.679407ms to process 0 records I0506 02:59:48.689730 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (7ms) I0506 02:59:48.697127 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (7ms) I0506 02:59:48.707540 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (10ms) I0506 02:59:48.714290 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (7ms) I0506 02:59:48.724246 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (10ms) I0506 02:59:48.731686 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (7ms) I0506 02:59:48.740752 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (9ms) I0506 02:59:48.748240 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (7ms) I0506 02:59:48.755365 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (7ms) I0506 02:59:48.762604 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (7ms) I0506 02:59:48.789961 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (27ms) I0506 02:59:48.891054 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (101ms) I0506 02:59:48.991514 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (100ms) I0506 02:59:49.091631 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (100ms) I0506 02:59:49.190627 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (99ms) I0506 02:59:49.292874 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (102ms) I0506 02:59:49.391534 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (99ms) I0506 02:59:49.491095 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (100ms) I0506 02:59:49.591585 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms) I0506 02:59:49.691368 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms) I0506 02:59:49.791603 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0506 02:59:49.891432 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (100ms) I0506 02:59:49.991842 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (100ms) I0506 02:59:50.091576 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (100ms) I0506 02:59:50.191090 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (99ms) I0506 02:59:50.292531 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (101ms) I0506 02:59:50.391778 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (99ms) I0506 02:59:50.495106 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (103ms) I0506 02:59:50.594885 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (100ms) I0506 02:59:50.692756 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (98ms) I0506 02:59:50.791356 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (99ms) I0506 02:59:50.892095 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (101ms) I0506 02:59:50.992413 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (100ms) I0506 02:59:50.992446 1 tasks_processing.go:74] worker 1 stopped. E0506 02:59:50.992456 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0506 02:59:50.992726 1 recorder.go:75] Recording config/workload_info with fingerprint=48195dea2e26446ebc94a670d96ad5d9b3a1f024575b6822000e8475c0770bf9 I0506 02:59:50.992743 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.338562389s to process 1 records E0506 02:59:50.992766 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.338s with: function \"workload_info\" failed with an error" I0506 02:59:50.993872 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0506 02:59:50.993884 1 periodic.go:216] Running conditional gatherer I0506 02:59:50.998891 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0506 02:59:51.005519 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:34316->172.30.0.10:53: read: connection refused E0506 02:59:51.005833 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0506 02:59:51.005888 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0506 02:59:51.011003 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0506 02:59:51.011015 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 02:59:51.011020 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 02:59:51.011023 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 02:59:51.011026 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 02:59:51.011029 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 02:59:51.011032 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 02:59:51.011034 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 02:59:51.011037 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 02:59:51.011040 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0506 02:59:51.011053 1 tasks_processing.go:45] number of workers: 3 I0506 02:59:51.011065 1 tasks_processing.go:69] worker 2 listening for tasks. I0506 02:59:51.011068 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0506 02:59:51.011075 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 02:59:51.011083 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 02:59:51.011086 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0506 02:59:51.011093 1 tasks_processing.go:74] worker 1 stopped. I0506 02:59:51.011101 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0506 02:59:51.011143 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0506 02:59:51.011155 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 674ns to process 1 records I0506 02:59:51.011184 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0506 02:59:51.011191 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.116µs to process 1 records I0506 02:59:51.011197 1 tasks_processing.go:74] worker 0 stopped. I0506 02:59:51.011369 1 tasks_processing.go:74] worker 2 stopped. I0506 02:59:51.011386 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 250.689µs to process 0 records I0506 02:59:51.011407 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:34316->172.30.0.10:53: read: connection refused I0506 02:59:51.011428 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0506 02:59:51.033498 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=4d7a3971a8d1dd91009aa646e7422b01b7ff254e929a7b56a97f8b19f59c635a I0506 02:59:51.033601 1 diskrecorder.go:70] Writing 112 records to /var/lib/insights-operator/insights-2026-05-06-025951.tar.gz I0506 02:59:51.040417 1 diskrecorder.go:51] Wrote 112 records to disk in 6ms I0506 02:59:51.040448 1 periodic.go:285] Gathering cluster info every 2h0m0s I0506 02:59:51.040465 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0506 02:59:59.815933 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:00:59.098407 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="538d4f1297a0a125b96731cb19207dbdc700f9acab4bf745dfeac4440df7abc4") W0506 03:00:59.098441 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created