W0507 12:55:19.865607 1 cmd.go:257] Using insecure, self-signed certificates I0507 12:55:20.027044 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 12:55:20.027355 1 observer_polling.go:159] Starting file observer I0507 12:55:20.464209 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0507 12:55:20.464629 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0507 12:55:20.464924 1 secure_serving.go:57] Forcing use of http/1.1 only W0507 12:55:20.464943 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0507 12:55:20.464948 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0507 12:55:20.464951 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0507 12:55:20.464954 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0507 12:55:20.464957 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0507 12:55:20.464959 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0507 12:55:20.465190 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0507 12:55:20.469485 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0507 12:55:20.469549 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"8ee28a1f-1915-41ec-8daa-5604530e5637", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0507 12:55:20.470740 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0507 12:55:20.470758 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0507 12:55:20.470763 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0507 12:55:20.470766 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0507 12:55:20.470803 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 12:55:20.470807 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 12:55:20.471134 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2991498347/tls.crt::/tmp/serving-cert-2991498347/tls.key" I0507 12:55:20.471653 1 secure_serving.go:213] Serving securely on [::]:8443 I0507 12:55:20.471691 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0507 12:55:20.483295 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0507 12:55:20.483324 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 12:55:20.483457 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0507 12:55:20.489491 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 12:55:20.489518 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 12:55:20.496164 1 secretconfigobserver.go:119] support secret does not exist I0507 12:55:20.504136 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 12:55:20.509318 1 secretconfigobserver.go:119] support secret does not exist I0507 12:55:20.511251 1 recorder.go:176] Pruning old reports every 7h29m55s, max age is 288h0m0s I0507 12:55:20.518702 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0507 12:55:20.518710 1 periodic.go:216] Running clusterconfig gatherer I0507 12:55:20.518722 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0507 12:55:20.518749 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0507 12:55:20.518751 1 tasks_processing.go:45] number of workers: 64 I0507 12:55:20.518756 1 insightsreport.go:296] Starting report retriever I0507 12:55:20.518762 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0507 12:55:20.518775 1 tasks_processing.go:69] worker 7 listening for tasks. I0507 12:55:20.518778 1 tasks_processing.go:69] worker 15 listening for tasks. I0507 12:55:20.518784 1 tasks_processing.go:69] worker 8 listening for tasks. I0507 12:55:20.518779 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 12:55:20.518793 1 tasks_processing.go:69] worker 4 listening for tasks. I0507 12:55:20.518794 1 tasks_processing.go:69] worker 11 listening for tasks. I0507 12:55:20.518800 1 tasks_processing.go:69] worker 13 listening for tasks. I0507 12:55:20.518798 1 tasks_processing.go:69] worker 3 listening for tasks. I0507 12:55:20.518811 1 tasks_processing.go:69] worker 14 listening for tasks. I0507 12:55:20.518809 1 tasks_processing.go:69] worker 6 listening for tasks. I0507 12:55:20.518811 1 tasks_processing.go:69] worker 39 listening for tasks. I0507 12:55:20.518814 1 tasks_processing.go:69] worker 38 listening for tasks. I0507 12:55:20.518822 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 12:55:20.518823 1 tasks_processing.go:71] worker 39 working on olm_operators task. I0507 12:55:20.518802 1 tasks_processing.go:69] worker 5 listening for tasks. I0507 12:55:20.518828 1 tasks_processing.go:71] worker 14 working on storage_classes task. I0507 12:55:20.518831 1 tasks_processing.go:69] worker 16 listening for tasks. I0507 12:55:20.518832 1 tasks_processing.go:69] worker 10 listening for tasks. I0507 12:55:20.518838 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 12:55:20.518840 1 tasks_processing.go:69] worker 28 listening for tasks. I0507 12:55:20.518833 1 tasks_processing.go:69] worker 22 listening for tasks. I0507 12:55:20.518845 1 tasks_processing.go:69] worker 19 listening for tasks. I0507 12:55:20.518812 1 tasks_processing.go:71] worker 3 working on node_features task. I0507 12:55:20.518848 1 tasks_processing.go:69] worker 9 listening for tasks. I0507 12:55:20.518852 1 tasks_processing.go:69] worker 29 listening for tasks. I0507 12:55:20.518817 1 tasks_processing.go:69] worker 26 listening for tasks. I0507 12:55:20.518857 1 tasks_processing.go:69] worker 25 listening for tasks. I0507 12:55:20.518819 1 tasks_processing.go:71] worker 6 working on node_logs task. I0507 12:55:20.518856 1 tasks_processing.go:69] worker 18 listening for tasks. I0507 12:55:20.518866 1 tasks_processing.go:69] worker 47 listening for tasks. I0507 12:55:20.518802 1 tasks_processing.go:71] worker 4 working on operators task. I0507 12:55:20.518873 1 tasks_processing.go:69] worker 32 listening for tasks. I0507 12:55:20.518876 1 tasks_processing.go:69] worker 41 listening for tasks. I0507 12:55:20.518876 1 tasks_processing.go:69] worker 49 listening for tasks. I0507 12:55:20.518796 1 tasks_processing.go:69] worker 12 listening for tasks. I0507 12:55:20.518885 1 tasks_processing.go:69] worker 42 listening for tasks. I0507 12:55:20.518879 1 tasks_processing.go:69] worker 17 listening for tasks. I0507 12:55:20.518892 1 tasks_processing.go:69] worker 52 listening for tasks. I0507 12:55:20.518850 1 tasks_processing.go:69] worker 24 listening for tasks. I0507 12:55:20.518899 1 tasks_processing.go:69] worker 46 listening for tasks. I0507 12:55:20.518902 1 tasks_processing.go:69] worker 53 listening for tasks. I0507 12:55:20.518903 1 tasks_processing.go:69] worker 35 listening for tasks. I0507 12:55:20.518901 1 tasks_processing.go:69] worker 51 listening for tasks. I0507 12:55:20.518909 1 tasks_processing.go:69] worker 44 listening for tasks. I0507 12:55:20.518911 1 tasks_processing.go:69] worker 50 listening for tasks. I0507 12:55:20.518914 1 tasks_processing.go:69] worker 37 listening for tasks. I0507 12:55:20.518810 1 tasks_processing.go:71] worker 13 working on machine_config_pools task. I0507 12:55:20.518920 1 tasks_processing.go:69] worker 58 listening for tasks. I0507 12:55:20.518924 1 tasks_processing.go:71] worker 15 working on overlapping_namespace_uids task. I0507 12:55:20.518929 1 tasks_processing.go:69] worker 63 listening for tasks. I0507 12:55:20.518932 1 tasks_processing.go:69] worker 55 listening for tasks. I0507 12:55:20.518929 1 tasks_processing.go:69] worker 45 listening for tasks. I0507 12:55:20.518944 1 tasks_processing.go:71] worker 38 working on lokistack task. I0507 12:55:20.518947 1 tasks_processing.go:69] worker 57 listening for tasks. I0507 12:55:20.518941 1 tasks_processing.go:69] worker 62 listening for tasks. I0507 12:55:20.518954 1 tasks_processing.go:71] worker 5 working on config_maps task. I0507 12:55:20.518956 1 tasks_processing.go:71] worker 57 working on dvo_metrics task. I0507 12:55:20.518960 1 tasks_processing.go:71] worker 41 working on image task. I0507 12:55:20.518961 1 tasks_processing.go:71] worker 62 working on machine_autoscalers task. I0507 12:55:20.519108 1 tasks_processing.go:69] worker 61 listening for tasks. I0507 12:55:20.519154 1 tasks_processing.go:71] worker 58 working on openshift_logging task. I0507 12:55:20.518893 1 tasks_processing.go:69] worker 43 listening for tasks. I0507 12:55:20.519275 1 tasks_processing.go:71] worker 43 working on authentication task. I0507 12:55:20.518804 1 tasks_processing.go:71] worker 11 working on pod_network_connectivity_checks task. I0507 12:55:20.518956 1 tasks_processing.go:71] worker 46 working on service_accounts task. I0507 12:55:20.518948 1 tasks_processing.go:71] worker 45 working on monitoring_persistent_volumes task. I0507 12:55:20.518938 1 tasks_processing.go:71] worker 55 working on ingress task. I0507 12:55:20.518820 1 tasks_processing.go:69] worker 20 listening for tasks. I0507 12:55:20.518861 1 tasks_processing.go:69] worker 40 listening for tasks. I0507 12:55:20.518866 1 tasks_processing.go:69] worker 31 listening for tasks. I0507 12:55:20.518869 1 tasks_processing.go:69] worker 48 listening for tasks. I0507 12:55:20.518833 1 tasks_processing.go:69] worker 27 listening for tasks. I0507 12:55:20.519476 1 tasks_processing.go:71] worker 20 working on container_runtime_configs task. I0507 12:55:20.518945 1 tasks_processing.go:71] worker 32 working on infrastructures task. I0507 12:55:20.519513 1 tasks_processing.go:71] worker 31 working on validating_webhook_configurations task. I0507 12:55:20.519522 1 tasks_processing.go:71] worker 48 working on container_images task. I0507 12:55:20.519113 1 tasks_processing.go:71] worker 17 working on aggregated_monitoring_cr_names task. I0507 12:55:20.518895 1 tasks_processing.go:69] worker 34 listening for tasks. I0507 12:55:20.518918 1 tasks_processing.go:71] worker 8 working on jaegers task. I0507 12:55:20.518888 1 tasks_processing.go:69] worker 33 listening for tasks. I0507 12:55:20.519637 1 tasks_processing.go:71] worker 33 working on feature_gates task. I0507 12:55:20.518911 1 tasks_processing.go:69] worker 36 listening for tasks. I0507 12:55:20.518939 1 tasks_processing.go:71] worker 63 working on ceph_cluster task. I0507 12:55:20.518920 1 tasks_processing.go:71] worker 0 working on cluster_apiserver task. I0507 12:55:20.518920 1 tasks_processing.go:71] worker 7 working on qemu_kubevirt_launcher_logs task. I0507 12:55:20.519776 1 tasks_processing.go:71] worker 36 working on machine_healthchecks task. I0507 12:55:20.518855 1 tasks_processing.go:69] worker 54 listening for tasks. I0507 12:55:20.519109 1 tasks_processing.go:71] worker 42 working on sap_config task. I0507 12:55:20.518938 1 tasks_processing.go:69] worker 56 listening for tasks. I0507 12:55:20.519122 1 tasks_processing.go:71] worker 49 working on storage_cluster task. I0507 12:55:20.519827 1 tasks_processing.go:71] worker 56 working on cost_management_metrics_configs task. I0507 12:55:20.519122 1 tasks_processing.go:71] worker 12 working on proxies task. I0507 12:55:20.519122 1 tasks_processing.go:71] worker 24 working on mutating_webhook_configurations task. I0507 12:55:20.519130 1 tasks_processing.go:71] worker 44 working on openshift_machine_api_events task. I0507 12:55:20.519131 1 tasks_processing.go:71] worker 19 working on image_pruners task. I0507 12:55:20.519134 1 tasks_processing.go:71] worker 53 working on openstack_controlplanes task. I0507 12:55:20.519132 1 tasks_processing.go:69] worker 59 listening for tasks. I0507 12:55:20.520098 1 tasks_processing.go:71] worker 59 working on certificate_signing_requests task. I0507 12:55:20.519136 1 tasks_processing.go:71] worker 16 working on openstack_version task. I0507 12:55:20.519139 1 tasks_processing.go:71] worker 35 working on support_secret task. I0507 12:55:20.519140 1 tasks_processing.go:71] worker 26 working on ingress_certificates task. I0507 12:55:20.519141 1 tasks_processing.go:71] worker 10 working on sap_pods task. I0507 12:55:20.519145 1 tasks_processing.go:71] worker 9 working on machines task. I0507 12:55:20.519143 1 tasks_processing.go:71] worker 51 working on openstack_dataplanedeployments task. I0507 12:55:20.519146 1 tasks_processing.go:71] worker 1 working on openstack_dataplanenodesets task. I0507 12:55:20.518824 1 tasks_processing.go:69] worker 21 listening for tasks. I0507 12:55:20.520667 1 tasks_processing.go:71] worker 21 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0507 12:55:20.519147 1 tasks_processing.go:71] worker 50 working on machine_configs task. I0507 12:55:20.519150 1 tasks_processing.go:71] worker 29 working on pdbs task. I0507 12:55:20.519152 1 tasks_processing.go:71] worker 28 working on machine_sets task. I0507 12:55:20.519153 1 tasks_processing.go:71] worker 37 working on oauths task. I0507 12:55:20.519155 1 tasks_processing.go:71] worker 18 working on nodes task. I0507 12:55:20.519157 1 tasks_processing.go:71] worker 22 working on clusterroles task. I0507 12:55:20.519157 1 tasks_processing.go:71] worker 47 working on sap_datahubs task. I0507 12:55:20.519161 1 tasks_processing.go:71] worker 61 working on crds task. I0507 12:55:20.519160 1 tasks_processing.go:71] worker 25 working on image_registries task. I0507 12:55:20.518860 1 tasks_processing.go:69] worker 30 listening for tasks. I0507 12:55:20.521220 1 tasks_processing.go:71] worker 30 working on operators_pods_and_events task. I0507 12:55:20.519166 1 tasks_processing.go:69] worker 60 listening for tasks. I0507 12:55:20.521263 1 tasks_processing.go:71] worker 60 working on tsdb_status task. I0507 12:55:20.518842 1 tasks_processing.go:69] worker 23 listening for tasks. I0507 12:55:20.519504 1 tasks_processing.go:71] worker 27 working on nodenetworkconfigurationpolicies task. I0507 12:55:20.521280 1 tasks_processing.go:71] worker 23 working on version task. W0507 12:55:20.521289 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 12:55:20.521309 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 31.637µs to process 0 records I0507 12:55:20.521350 1 tasks_processing.go:71] worker 60 working on active_alerts task. W0507 12:55:20.521376 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 12:55:20.521387 1 tasks_processing.go:71] worker 60 working on nodenetworkstates task. I0507 12:55:20.519510 1 tasks_processing.go:71] worker 40 working on silenced_alerts task. I0507 12:55:20.521456 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 25.347µs to process 0 records W0507 12:55:20.521470 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 12:55:20.521479 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 22.324µs to process 0 records I0507 12:55:20.519571 1 tasks_processing.go:71] worker 34 working on networks task. I0507 12:55:20.521529 1 tasks_processing.go:74] worker 40 stopped. I0507 12:55:20.519811 1 tasks_processing.go:71] worker 54 working on metrics task. I0507 12:55:20.518950 1 tasks_processing.go:71] worker 2 working on schedulers task. W0507 12:55:20.521642 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 12:55:20.519118 1 tasks_processing.go:71] worker 52 working on install_plans task. I0507 12:55:20.521660 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 45.699µs to process 0 records I0507 12:55:20.521655 1 tasks_processing.go:74] worker 54 stopped. I0507 12:55:20.522670 1 tasks_processing.go:74] worker 13 stopped. I0507 12:55:20.522682 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 3.739128ms to process 0 records E0507 12:55:20.522689 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0507 12:55:20.522697 1 tasks_processing.go:74] worker 3 stopped. I0507 12:55:20.522704 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 3.843454ms to process 0 records I0507 12:55:20.526263 1 tasks_processing.go:74] worker 11 stopped. E0507 12:55:20.526280 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0507 12:55:20.526290 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 6.962531ms to process 0 records I0507 12:55:20.526297 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 7.330346ms to process 0 records I0507 12:55:20.526304 1 tasks_processing.go:74] worker 38 stopped. I0507 12:55:20.526522 1 tasks_processing.go:74] worker 41 stopped. I0507 12:55:20.526648 1 recorder.go:75] Recording config/image with fingerprint=e3cc461fb09dc19aa79b800e7cc067dc2bf9f3dbe16699bc0c05974087126341 I0507 12:55:20.526661 1 gather.go:177] gatherer "clusterconfig" function "image" took 7.549243ms to process 1 records I0507 12:55:20.530713 1 tasks_processing.go:74] worker 62 stopped. I0507 12:55:20.530726 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 11.742317ms to process 0 records I0507 12:55:20.530735 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 11.502825ms to process 0 records I0507 12:55:20.530740 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 11.239877ms to process 0 records I0507 12:55:20.530745 1 tasks_processing.go:74] worker 20 stopped. I0507 12:55:20.530748 1 tasks_processing.go:74] worker 58 stopped. I0507 12:55:20.530887 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0507 12:55:20.530903 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 12:55:20.530907 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 12:55:20.530911 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 12:55:20.530924 1 controller.go:531] The operator is still being initialized I0507 12:55:20.530931 1 controller.go:554] The operator is healthy I0507 12:55:20.531002 1 tasks_processing.go:74] worker 39 stopped. I0507 12:55:20.531014 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 12.164644ms to process 0 records I0507 12:55:20.531395 1 tasks_processing.go:74] worker 55 stopped. I0507 12:55:20.531916 1 recorder.go:75] Recording config/ingress with fingerprint=c65063a8315e472b4cddfbddf5e678f0b2fe26ba265866e88af3081afce3f866 I0507 12:55:20.531987 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 12.010714ms to process 1 records I0507 12:55:20.532333 1 recorder.go:75] Recording config/authentication with fingerprint=7920634de2525861db2340bed329c8ccca980a47977059683581b24b6385f9b9 I0507 12:55:20.532370 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 12.235754ms to process 1 records I0507 12:55:20.532334 1 tasks_processing.go:74] worker 43 stopped. I0507 12:55:20.533858 1 tasks_processing.go:74] worker 6 stopped. I0507 12:55:20.533873 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 14.989452ms to process 0 records I0507 12:55:20.533914 1 tasks_processing.go:74] worker 14 stopped. I0507 12:55:20.533997 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=564d73ed46332f56c987015c9cbc34bb2cef03f3ac1e1cb0b2471074eaec5173 I0507 12:55:20.534018 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=d7b3419f560ac49b6c87b565447c8473481b768cc1e7fd73e8456cf2f6056129 I0507 12:55:20.534026 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 15.075053ms to process 2 records I0507 12:55:20.539352 1 tasks_processing.go:74] worker 42 stopped. I0507 12:55:20.539371 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 19.526697ms to process 0 records I0507 12:55:20.544967 1 tasks_processing.go:74] worker 10 stopped. I0507 12:55:20.544985 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 24.58218ms to process 0 records I0507 12:55:20.545000 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 24.836327ms to process 0 records I0507 12:55:20.545006 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 24.123472ms to process 0 records I0507 12:55:20.545010 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 24.928541ms to process 0 records I0507 12:55:20.545017 1 tasks_processing.go:74] worker 53 stopped. I0507 12:55:20.545020 1 tasks_processing.go:74] worker 16 stopped. I0507 12:55:20.545023 1 tasks_processing.go:74] worker 28 stopped. I0507 12:55:20.545038 1 tasks_processing.go:74] worker 12 stopped. I0507 12:55:20.545114 1 recorder.go:75] Recording config/proxy with fingerprint=5929cd31cbcb70b90e39b4b979f65206ac91e64874723a89503dd2158bc92fe4 I0507 12:55:20.545132 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 25.168259ms to process 1 records I0507 12:55:20.545153 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 24.05376ms to process 0 records I0507 12:55:20.545167 1 tasks_processing.go:74] worker 47 stopped. I0507 12:55:20.545179 1 tasks_processing.go:74] worker 32 stopped. I0507 12:55:20.545707 1 recorder.go:75] Recording config/infrastructure with fingerprint=64668be32b5fde0292de694fcbeebb62526c5917df13e03b13e75a70f4938b96 I0507 12:55:20.545724 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 25.660444ms to process 1 records I0507 12:55:20.545831 1 recorder.go:75] Recording config/featuregate with fingerprint=6d71765bb1605d9e7cf11d1181ab039ad70e11daa4c45203bc166e06372b2e80 I0507 12:55:20.545831 1 tasks_processing.go:74] worker 33 stopped. I0507 12:55:20.545841 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 25.749563ms to process 1 records I0507 12:55:20.548386 1 tasks_processing.go:74] worker 63 stopped. I0507 12:55:20.548405 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 28.727564ms to process 0 records I0507 12:55:20.548415 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 28.555685ms to process 0 records I0507 12:55:20.548420 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 28.821964ms to process 0 records I0507 12:55:20.548426 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 27.884145ms to process 0 records I0507 12:55:20.548433 1 tasks_processing.go:74] worker 51 stopped. I0507 12:55:20.548441 1 tasks_processing.go:74] worker 8 stopped. I0507 12:55:20.548442 1 tasks_processing.go:74] worker 49 stopped. I0507 12:55:20.548552 1 tasks_processing.go:74] worker 9 stopped. E0507 12:55:20.548569 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0507 12:55:20.548585 1 gather.go:177] gatherer "clusterconfig" function "machines" took 28.101567ms to process 0 records I0507 12:55:20.548735 1 tasks_processing.go:74] worker 27 stopped. I0507 12:55:20.548748 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 27.452725ms to process 0 records I0507 12:55:20.549105 1 tasks_processing.go:74] worker 31 stopped. I0507 12:55:20.549284 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=5f8a35db3222f3102702e058cfb6d9fd82091a9e964a9cb4c42e2257b85119d2 I0507 12:55:20.549373 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=1ab1b075ea7e328376cfeb4787243b08e161a36dcb9558a737bcbe87cb8ba650 I0507 12:55:20.549394 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=a2a522d9a2ea62a613e1299f9872c312e4119eaf9e26baf46904fb6a4e94be8c I0507 12:55:20.549419 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=c2e41bcc3c377588bc801632967eb193db60717f849aab030fb57b3bd4124900 I0507 12:55:20.549445 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=e1b422960e713a58890a10249684a00885a1fa33bc66cafa2273538d764d5e8e I0507 12:55:20.549485 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=1d1a9a713fea60aec44b9bae0e51fab438ef0913e249d2e91a28ab4f80062f6c I0507 12:55:20.549521 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=b0bc38bc0ead2d8fed654a9da0779be44b30c4bf51f915f0a359a93610dc0ead W0507 12:55:20.549523 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 12:55:20.549564 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=808f318638bf5bd1514463aa7450643f4904650e296b6a8d60fab35bb60cee91 I0507 12:55:20.549589 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=9c1da904be8003d88d30dc3257a8561d9d233d40bd924c4ddb35e86e75ebbdbf I0507 12:55:20.549627 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=1b85650a90eda473635be0410b0f07ccabfebcd3dbf4ec2b195401f4ce975864 I0507 12:55:20.549653 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=453099e82559232952cb8d465cbe91217946b037c989638d0981216d714600cd I0507 12:55:20.549661 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 29.576954ms to process 11 records I0507 12:55:20.550075 1 tasks_processing.go:74] worker 60 stopped. I0507 12:55:20.550092 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 28.677899ms to process 0 records E0507 12:55:20.550103 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0507 12:55:20.550130 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0507 12:55:20.550147 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 29.388576ms to process 1 records I0507 12:55:20.550154 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 30.244629ms to process 0 records I0507 12:55:20.550160 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 29.493366ms to process 0 records I0507 12:55:20.550167 1 tasks_processing.go:74] worker 1 stopped. I0507 12:55:20.550173 1 tasks_processing.go:74] worker 50 stopped. I0507 12:55:20.550178 1 tasks_processing.go:74] worker 56 stopped. I0507 12:55:20.550186 1 tasks_processing.go:74] worker 36 stopped. E0507 12:55:20.550200 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0507 12:55:20.550218 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 30.400032ms to process 0 records I0507 12:55:20.550528 1 tasks_processing.go:74] worker 15 stopped. I0507 12:55:20.550549 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0507 12:55:20.550560 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 31.589587ms to process 1 records I0507 12:55:20.555325 1 tasks_processing.go:74] worker 37 stopped. I0507 12:55:20.555602 1 recorder.go:75] Recording config/oauth with fingerprint=50ae60e23049b548b93eb35fb5c750bda0bfa92041e5d25bf7853fc450680f92 I0507 12:55:20.555633 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 34.390383ms to process 1 records I0507 12:55:20.561313 1 tasks_processing.go:74] worker 19 stopped. I0507 12:55:20.561554 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=52ea3d45f87fdb49cf01280d2fd2c9a597bd6e997ffb6883d653517b26c30e4d I0507 12:55:20.561567 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 41.276233ms to process 1 records I0507 12:55:20.561639 1 tasks_processing.go:74] worker 0 stopped. I0507 12:55:20.561687 1 recorder.go:75] Recording config/apiserver with fingerprint=bb6c91dd403a5f454691bb70731b148be3a3cba8f0c485b10803cd8199ce1322 I0507 12:55:20.561696 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 41.739364ms to process 1 records I0507 12:55:20.561777 1 tasks_processing.go:74] worker 34 stopped. I0507 12:55:20.561792 1 recorder.go:75] Recording config/network with fingerprint=5116f8e65bd6a61bb0b936923966d858c2ddb2105d780c99b479d40ce90b2047 I0507 12:55:20.561798 1 gather.go:177] gatherer "clusterconfig" function "networks" took 40.090742ms to process 1 records I0507 12:55:20.564719 1 tasks_processing.go:74] worker 44 stopped. I0507 12:55:20.564733 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 44.69601ms to process 0 records E0507 12:55:20.564746 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0507 12:55:20.564754 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 44.575674ms to process 0 records I0507 12:55:20.564761 1 tasks_processing.go:74] worker 35 stopped. I0507 12:55:20.567429 1 tasks_processing.go:74] worker 25 stopped. I0507 12:55:20.568541 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=afe0b1f11dc35af890a243f81fdd11e734b0d1ef4cc31d3d680d2975e125285c I0507 12:55:20.568564 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 46.225103ms to process 1 records I0507 12:55:20.568634 1 tasks_processing.go:74] worker 22 stopped. I0507 12:55:20.568832 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=9a05b66e5558ebccfe2989f607d11cbc356124591b245cc58b3f9d905655bb61 I0507 12:55:20.568986 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8de1a6b968b16c7e67eb3993784eaa1782acacdcb4dfecc788186f79a1376cd4 I0507 12:55:20.568996 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 46.620626ms to process 2 records I0507 12:55:20.570948 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 12:55:20.570955 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0507 12:55:20.570967 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 12:55:20.571045 1 gather_logs.go:145] no pods in namespace were found I0507 12:55:20.571061 1 tasks_processing.go:74] worker 7 stopped. I0507 12:55:20.571071 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 51.280202ms to process 0 records I0507 12:55:20.571211 1 tasks_processing.go:74] worker 2 stopped. I0507 12:55:20.571294 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=adaaa9c4e9e545f9d557377df4c558df873d1a36eb02ecef6f650733faf87a97 I0507 12:55:20.571319 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 49.556886ms to process 1 records I0507 12:55:20.573806 1 tasks_processing.go:74] worker 45 stopped. I0507 12:55:20.573824 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 54.46318ms to process 0 records I0507 12:55:20.579934 1 tasks_processing.go:74] worker 23 stopped. I0507 12:55:20.580169 1 recorder.go:75] Recording config/version with fingerprint=7774bed362276bb24bf9faf6f3a1d0e511d5c548adfcf8b478a9071c306a0165 I0507 12:55:20.580182 1 recorder.go:75] Recording config/id with fingerprint=d055d856c30bb7d681a81531ed67ec755fc2784b50985811ea038a211c8b3e96 I0507 12:55:20.580189 1 gather.go:177] gatherer "clusterconfig" function "version" took 58.643875ms to process 2 records I0507 12:55:20.580198 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 60.649058ms to process 0 records I0507 12:55:20.580203 1 tasks_processing.go:74] worker 17 stopped. I0507 12:55:20.580947 1 tasks_processing.go:74] worker 29 stopped. I0507 12:55:20.581111 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=079e995e2c608558f97bbcdb0856526576d14d93fc4d7bdad5ee5a62b960ca63 I0507 12:55:20.581161 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=cf90a5f4075c30c68a3521f14a128dc3cad96557609f2cc015ee8a5598b2f46e I0507 12:55:20.581201 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=9344286a9bdbf0aac7630a18ebd6786b162920612b381b7bd5e43224183e56bd I0507 12:55:20.581227 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 60.216284ms to process 3 records I0507 12:55:20.583771 1 base_controller.go:82] Caches are synced for ConfigController I0507 12:55:20.583788 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0507 12:55:20.585887 1 tasks_processing.go:74] worker 59 stopped. I0507 12:55:20.585902 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 65.774619ms to process 0 records I0507 12:55:20.596866 1 tasks_processing.go:74] worker 24 stopped. I0507 12:55:20.597025 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=32944c9bd3c919cf05852a257274246b07433cc135400d0364699188216133c0 I0507 12:55:20.597060 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=06643c925ea3b822cb002341a8470e5a57e602cdd0ab768ca8c0514601839721 I0507 12:55:20.597092 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=8346f597045efc1bca45e0a6079fb98394f7f85114885a7a0c10ec8f5cee0228 I0507 12:55:20.597101 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 76.852616ms to process 3 records I0507 12:55:20.597554 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0507 12:55:20.597575 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0507 12:55:20.597753 1 operator.go:328] started I0507 12:55:20.597767 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0507 12:55:20.599916 1 tasks_processing.go:74] worker 61 stopped. I0507 12:55:20.600690 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=8ad71f5a4bcee4baef4b9c424298035dce72d3567a3e42cfc695583c121a5e55 I0507 12:55:20.601030 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=4b9fecdfec0fb05ba132655c8042e586fa4bec380dfafa9215ca90f609329e29 I0507 12:55:20.601044 1 gather.go:177] gatherer "clusterconfig" function "crds" took 78.779229ms to process 2 records I0507 12:55:20.619337 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 12:55:20.622961 1 tasks_processing.go:74] worker 48 stopped. I0507 12:55:20.623073 1 recorder.go:75] Recording config/running_containers with fingerprint=e1f60fb3cfe7e1552072f24764de51f5b12a773128bdf9dcd5fcd44700a86f34 I0507 12:55:20.623094 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 103.421342ms to process 1 records I0507 12:55:20.632485 1 prometheus_rules.go:88] Prometheus rules successfully created I0507 12:55:20.632722 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 12:55:20.632735 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 12:55:20.632741 1 controller.go:254] Source scaController *sca.Controller is not ready I0507 12:55:20.632746 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0507 12:55:20.632750 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 12:55:20.632772 1 controller.go:531] The operator is still being initialized I0507 12:55:20.632783 1 controller.go:554] The operator is healthy I0507 12:55:20.634917 1 tasks_processing.go:74] worker 21 stopped. I0507 12:55:20.634933 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 114.230489ms to process 0 records E0507 12:55:20.639233 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%276f31fee5-5e1f-4710-86f5-9dbe6d4194b7%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:45838->172.30.0.10:53: read: connection refused I0507 12:55:20.639246 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%276f31fee5-5e1f-4710-86f5-9dbe6d4194b7%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:45838->172.30.0.10:53: read: connection refused I0507 12:55:20.650939 1 tasks_processing.go:74] worker 18 stopped. I0507 12:55:20.651347 1 recorder.go:75] Recording config/node/ip-10-0-0-119.ec2.internal with fingerprint=d7275b6d5477fbfd7b10756ab15803031669feaaf7ef372438f6cdcbc46e2fb0 I0507 12:55:20.651438 1 recorder.go:75] Recording config/node/ip-10-0-1-145.ec2.internal with fingerprint=5b0fd254b51023dd47bc1a9de4cec6f6433bfdcdc8b596793000421d813c0d88 I0507 12:55:20.651534 1 recorder.go:75] Recording config/node/ip-10-0-2-63.ec2.internal with fingerprint=c56c3662f7ca8f4242173a9b702e0e13105fcb81a278b84b9684c09bfb385846 I0507 12:55:20.651546 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 129.967294ms to process 3 records I0507 12:55:20.651944 1 tasks_processing.go:74] worker 5 stopped. E0507 12:55:20.651960 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0507 12:55:20.651967 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0507 12:55:20.651971 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0507 12:55:20.651980 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0507 12:55:20.652016 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0507 12:55:20.652023 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0507 12:55:20.652028 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0507 12:55:20.652034 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0507 12:55:20.652073 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0507 12:55:20.652081 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0507 12:55:20.652087 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 132.974929ms to process 7 records I0507 12:55:20.669161 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0507 12:55:20.672467 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:41980->172.30.0.10:53: read: connection refused I0507 12:55:20.672481 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:41980->172.30.0.10:53: read: connection refused I0507 12:55:20.682766 1 tasks_processing.go:74] worker 26 stopped. E0507 12:55:20.682784 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0507 12:55:20.682792 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q53j087pbnvoincjfagms98n05bk2h6-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q53j087pbnvoincjfagms98n05bk2h6-primary-cert-bundle-secret" not found I0507 12:55:20.682876 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=fe5eb02e9c09f15203f164622d1adc34d2d06762bc64dc9b00a1252cbef3c388 I0507 12:55:20.682892 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 162.515095ms to process 1 records I0507 12:55:20.698648 1 base_controller.go:82] Caches are synced for LoggingSyncer I0507 12:55:20.698662 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0507 12:55:20.969707 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0507 12:55:20.969726 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0507 12:55:20.969912 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-2kkx9 pod in namespace openshift-dns (previous: false). I0507 12:55:21.192983 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2kkx9 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-2kkx9\" is waiting to start: ContainerCreating" I0507 12:55:21.193004 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-2kkx9\" is waiting to start: ContainerCreating" I0507 12:55:21.193012 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-2kkx9 pod in namespace openshift-dns (previous: false). I0507 12:55:21.380347 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2kkx9 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-2kkx9\" is waiting to start: ContainerCreating" I0507 12:55:21.380369 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-2kkx9\" is waiting to start: ContainerCreating" I0507 12:55:21.380385 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-lrwv8 pod in namespace openshift-dns (previous: false). W0507 12:55:21.548703 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 12:55:21.612459 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lrwv8 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-lrwv8\" is waiting to start: ContainerCreating" I0507 12:55:21.612479 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-lrwv8\" is waiting to start: ContainerCreating" I0507 12:55:21.612488 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-lrwv8 pod in namespace openshift-dns (previous: false). I0507 12:55:21.775981 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lrwv8 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-lrwv8\" is waiting to start: ContainerCreating" I0507 12:55:21.776001 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-lrwv8\" is waiting to start: ContainerCreating" I0507 12:55:21.776015 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-xrxxk pod in namespace openshift-dns (previous: false). I0507 12:55:21.977193 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0507 12:55:22.018381 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xrxxk pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-xrxxk\" is waiting to start: ContainerCreating" I0507 12:55:22.018402 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-xrxxk\" is waiting to start: ContainerCreating" I0507 12:55:22.018413 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-xrxxk pod in namespace openshift-dns (previous: false). I0507 12:55:22.174854 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xrxxk pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-xrxxk\" is waiting to start: ContainerCreating" I0507 12:55:22.174875 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-xrxxk\" is waiting to start: ContainerCreating" I0507 12:55:22.174887 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-cj8jd pod in namespace openshift-dns (previous: false). I0507 12:55:22.377195 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 12:55:22.377212 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-gqhdr pod in namespace openshift-dns (previous: false). I0507 12:55:22.379783 1 tasks_processing.go:74] worker 4 stopped. I0507 12:55:22.379831 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=5d4a145028b439084c067eddf9a340e11a0e3b999437ba4da3b3e47c254792b6 I0507 12:55:22.379871 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=0132ad8028e84e9524ffce6a0eb6273474e3846ffc35fe0f269f20aed5541b0e I0507 12:55:22.379901 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0507 12:55:22.379926 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=4c4b5ed209faa62c4fe8a68a5aa6ca354f82d4cccdf20718c1c73481b881e49d I0507 12:55:22.379944 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0507 12:55:22.379966 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=90e89888f4aaa3e2a8899e8ff4bb00dc0eff8bc3be8c4e8ce082086fa1cf77d3 I0507 12:55:22.380012 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=8de88615ecfd7005185b4387a2c4a27d28f8a5d376eb88c2de5a09b0dc44c5af I0507 12:55:22.380036 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=7c30d9c8a2a50a6b32f3464d8ac2101db56aa83818789863b109ff794256afa9 I0507 12:55:22.380051 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=7b9f4eb12a4c0e465fcc9b506dd9978355e27d5835b23abe141a963ea1a01308 I0507 12:55:22.380067 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=e21c9cc0511fc099062fcc27cadad26221405c0d80ca11d6a14aabd605db1d98 I0507 12:55:22.380077 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0507 12:55:22.380093 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=a115109b9326934da96bc443a2784850c9a9d5c4aca61f4b3033142c42f574d8 I0507 12:55:22.380105 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0507 12:55:22.380121 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=d8b936271407ae7ac3cb3933fb600214346a9c54b1605515cf4c009cac19b359 I0507 12:55:22.380130 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0507 12:55:22.380142 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=0aad22400a6e0c3db224a6f30a7cf5b6cf289e281d110f138d811eb37071e19a I0507 12:55:22.380149 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0507 12:55:22.380164 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=981a05ab9d779f7fcf6d8438a6277dc10cf746db271352bfb1f7537ac20e10bf I0507 12:55:22.380283 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=2d3d207fd7e1a454bf484246e2aa81ae0645c093933ed1040d4a52ba172524a1 I0507 12:55:22.380292 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0507 12:55:22.380299 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0507 12:55:22.380332 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0507 12:55:22.380355 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=e5d8bd2fec0c5bd37bc2f146bb8f47dc5f8752b7f7427d70e0b395db0df455c8 I0507 12:55:22.380384 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=8a366d4d796af036298393fc5e4707aef54d16b422f3e2f6827245129bb392d5 I0507 12:55:22.380394 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0507 12:55:22.380410 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=ff8db3cc44c1ed967faa04e0d038b230c5434b6c7728c3e325ce322877c5dc17 I0507 12:55:22.380419 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0507 12:55:22.380431 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=78d1e042cccab3db01f15983f945a086230c4dbc3e0b1a5ccb0e9da4aeb82b03 I0507 12:55:22.380445 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=e3646c8ff8b35269a596c8b3c84c728da981bfdbf206c2fe20166493b8968a99 I0507 12:55:22.380458 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=1d7c4335348052703726e03d36ca2489146ce8c5618caeed1eb930bd212b5b87 I0507 12:55:22.380475 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=01a6da3ce2438f8988e56eefbe5d4a3cca7a1fe3c218e3e3f8660dfb8e5a5d9e I0507 12:55:22.380488 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=ed53a8cc230314c1a778a7e103dfda231a5a4c8798b714d2e9b08eab33d6386a I0507 12:55:22.380515 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=3ff39445acf522c59ee11c81612c05e702bf26e1cdf88b37ad425a326e4c9e4b I0507 12:55:22.380531 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0507 12:55:22.380538 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0507 12:55:22.380545 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.860897632s to process 35 records W0507 12:55:22.549332 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 12:55:22.574317 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 12:55:22.574332 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-z4zl9 pod in namespace openshift-dns (previous: false). I0507 12:55:22.774417 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 12:55:22.774436 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5f58965b64-nnkbz pod in namespace openshift-image-registry (previous: false). I0507 12:55:22.977104 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5f58965b64-nnkbz pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5f58965b64-nnkbz\" is waiting to start: ContainerCreating" I0507 12:55:22.977124 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5f58965b64-nnkbz\" is waiting to start: ContainerCreating" I0507 12:55:22.977138 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-658865b859-bxxcm pod in namespace openshift-image-registry (previous: false). I0507 12:55:23.174347 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-658865b859-bxxcm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-658865b859-bxxcm\" is waiting to start: ContainerCreating" I0507 12:55:23.174365 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-658865b859-bxxcm\" is waiting to start: ContainerCreating" I0507 12:55:23.174376 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-658865b859-cvxsv pod in namespace openshift-image-registry (previous: false). I0507 12:55:23.373583 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-658865b859-cvxsv pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-658865b859-cvxsv\" is waiting to start: ContainerCreating" I0507 12:55:23.373602 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-658865b859-cvxsv\" is waiting to start: ContainerCreating" I0507 12:55:23.373627 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5x5gd pod in namespace openshift-image-registry (previous: false). W0507 12:55:23.548592 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 12:55:23.574321 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 12:55:23.574338 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-69vs7 pod in namespace openshift-image-registry (previous: false). I0507 12:55:23.775064 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 12:55:23.775083 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-tfpbq pod in namespace openshift-image-registry (previous: false). I0507 12:55:23.975901 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 12:55:23.975919 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-55474bbd5c-hx6p6 pod in namespace openshift-ingress (previous: false). I0507 12:55:24.184986 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-55474bbd5c-hx6p6 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-55474bbd5c-hx6p6\" is waiting to start: ContainerCreating" I0507 12:55:24.185004 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-55474bbd5c-hx6p6\" is waiting to start: ContainerCreating" I0507 12:55:24.185016 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-66f767b8f-6qs4c pod in namespace openshift-ingress (previous: false). I0507 12:55:24.375273 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-66f767b8f-6qs4c pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-66f767b8f-6qs4c\" is waiting to start: ContainerCreating" I0507 12:55:24.375290 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-66f767b8f-6qs4c\" is waiting to start: ContainerCreating" I0507 12:55:24.375302 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-66f767b8f-85vl7 pod in namespace openshift-ingress (previous: false). W0507 12:55:24.548968 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 12:55:24.574158 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-66f767b8f-85vl7 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-66f767b8f-85vl7\" is waiting to start: ContainerCreating" I0507 12:55:24.574174 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-66f767b8f-85vl7\" is waiting to start: ContainerCreating" I0507 12:55:24.574185 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-4qjk9 pod in namespace openshift-ingress-canary (previous: false). I0507 12:55:24.774820 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-wczsp pod in namespace openshift-ingress-canary (previous: false). I0507 12:55:24.974834 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-z8tbk pod in namespace openshift-ingress-canary (previous: false). I0507 12:55:25.176913 1 tasks_processing.go:74] worker 30 stopped. I0507 12:55:25.177017 1 recorder.go:75] Recording events/openshift-dns with fingerprint=f8b90addb720eb8f72f6d4d779dbe9839926d6a10456063711247de835f33180 I0507 12:55:25.177107 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=5efeca3afde48cce29525c83aff637597ff6506550583549b3b043a4ef554570 I0507 12:55:25.177137 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=8f324977816c78d8dddf00f75aac5560de6b3e4433b86a1c68fe6550ce7d4b40 I0507 12:55:25.177184 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=3cc78893dd80d4a8cde6ef06900ca85206c5b8b83a02c69641f5d11857a92f8b I0507 12:55:25.177222 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=0c00bb46f49e6879fc1790370d61fb0f73a34ac56142f801c3c4c17d4087c8fe I0507 12:55:25.177229 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-4qjk9/serve-healthcheck-canary_current.log with fingerprint=7b6caf51f61eb0e99319dd2da0b12fffc6f1ca03158939cca17d9875b098f8cf I0507 12:55:25.177234 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-wczsp/serve-healthcheck-canary_current.log with fingerprint=3bcefc89b3397e67bda0ba4a6843a4f3fe95b0c2c6007c5be7b4fb1ecb74f941 I0507 12:55:25.177238 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-z8tbk/serve-healthcheck-canary_current.log with fingerprint=faf60770c94f8da7c4941128b73c09069c13ee5c166d0ba64d5e48199c861d03 I0507 12:55:25.177244 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.655677082s to process 8 records W0507 12:55:25.549078 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0507 12:55:25.549115 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 12:55:25.549131 1 tasks_processing.go:74] worker 57 stopped. E0507 12:55:25.549141 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 12:55:25.549153 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0507 12:55:25.549167 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0507 12:55:25.549176 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.030162024s to process 1 records I0507 12:55:33.058979 1 tasks_processing.go:74] worker 52 stopped. I0507 12:55:33.059026 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0507 12:55:33.059043 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.537306358s to process 1 records I0507 12:55:33.500031 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 12:55:33.726767 1 tasks_processing.go:74] worker 46 stopped. I0507 12:55:33.727043 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=698b3ed6ac2dcbbe305b75e3c37787498192c269ee2964c1d49d551d6371b6d6 I0507 12:55:33.727060 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.20744707s to process 1 records E0507 12:55:33.727120 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.208s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0507 12:55:33.728224 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0507 12:55:33.728240 1 periodic.go:216] Running workloads gatherer I0507 12:55:33.728254 1 tasks_processing.go:45] number of workers: 2 I0507 12:55:33.728268 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 12:55:33.728266 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 12:55:33.728272 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0507 12:55:33.728279 1 tasks_processing.go:71] worker 0 working on workload_info task. I0507 12:55:33.753265 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0507 12:55:33.758696 1 tasks_processing.go:74] worker 1 stopped. I0507 12:55:33.758714 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.400018ms to process 0 records I0507 12:55:33.762986 1 gather_workloads_info.go:387] No image sha256:c886c2a85f0c920fcd6927a7c76644a422cf77f07b185120a8021e0e98d6acb9 (10ms) I0507 12:55:33.771814 1 gather_workloads_info.go:387] No image sha256:3a1c7ec9bb0db343348170a70697ea3209ed81e22f1259ff694190e5d04ef250 (9ms) I0507 12:55:33.780843 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (9ms) I0507 12:55:33.790096 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (9ms) I0507 12:55:33.798976 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (9ms) I0507 12:55:33.808198 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (9ms) I0507 12:55:33.821468 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (13ms) I0507 12:55:33.830986 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (10ms) I0507 12:55:33.840964 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (10ms) I0507 12:55:33.851942 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (11ms) I0507 12:55:33.862141 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (10ms) I0507 12:55:33.963285 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (101ms) I0507 12:55:34.065777 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (102ms) I0507 12:55:34.162331 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (97ms) I0507 12:55:34.263325 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (101ms) I0507 12:55:34.364443 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (101ms) I0507 12:55:34.462484 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (98ms) I0507 12:55:34.563517 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (101ms) I0507 12:55:34.663025 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (99ms) I0507 12:55:34.764405 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (101ms) I0507 12:55:34.862258 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (98ms) I0507 12:55:34.964045 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (102ms) I0507 12:55:35.063250 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (99ms) I0507 12:55:35.164091 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (101ms) I0507 12:55:35.264519 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0507 12:55:35.362699 1 gather_workloads_info.go:387] No image sha256:4b748615a43be416d52c33df03e2cdec89ededded1d6a2ade167c5a955d56e5f (98ms) I0507 12:55:35.464537 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (102ms) I0507 12:55:35.563245 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (99ms) I0507 12:55:35.662996 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (100ms) I0507 12:55:35.766593 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (104ms) I0507 12:55:35.863095 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (96ms) I0507 12:55:35.964516 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (101ms) I0507 12:55:36.062488 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (98ms) I0507 12:55:36.162555 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (100ms) I0507 12:55:36.262949 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms) I0507 12:55:36.362803 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (100ms) I0507 12:55:36.362834 1 tasks_processing.go:74] worker 0 stopped. E0507 12:55:36.362845 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0507 12:55:36.363098 1 recorder.go:75] Recording config/workload_info with fingerprint=c275224f37e3a2c3750032c7a447d3e3a6a75f444df3b425e910e3f1ab6e4d09 I0507 12:55:36.363114 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.634484073s to process 1 records E0507 12:55:36.363148 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.634s with: function \"workload_info\" failed with an error" I0507 12:55:36.364253 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0507 12:55:36.364266 1 periodic.go:216] Running conditional gatherer I0507 12:55:36.371117 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0507 12:55:36.377755 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.13:55234->172.30.0.10:53: read: connection refused E0507 12:55:36.378019 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 12:55:36.378093 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0507 12:55:36.384945 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0507 12:55:36.384960 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 12:55:36.384966 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 12:55:36.384969 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 12:55:36.384972 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 12:55:36.384975 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 12:55:36.384978 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 12:55:36.384981 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 12:55:36.384984 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 12:55:36.384987 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0507 12:55:36.385003 1 tasks_processing.go:45] number of workers: 3 I0507 12:55:36.385014 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 12:55:36.385018 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0507 12:55:36.385026 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 12:55:36.385039 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 12:55:36.385044 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0507 12:55:36.385047 1 tasks_processing.go:74] worker 1 stopped. I0507 12:55:36.385059 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0507 12:55:36.385103 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0507 12:55:36.385118 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 857ns to process 1 records I0507 12:55:36.385149 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0507 12:55:36.385157 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.606µs to process 1 records I0507 12:55:36.385162 1 tasks_processing.go:74] worker 0 stopped. I0507 12:55:36.385328 1 tasks_processing.go:74] worker 2 stopped. I0507 12:55:36.385341 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 247.835µs to process 0 records I0507 12:55:36.385360 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.13:55234->172.30.0.10:53: read: connection refused I0507 12:55:36.385386 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0507 12:55:36.408125 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=070a18fc8ccbf497137882e8287f8014fb704a3f36fbeb6b0db50f6db685113e I0507 12:55:36.408250 1 diskrecorder.go:70] Writing 101 records to /var/lib/insights-operator/insights-2026-05-07-125536.tar.gz I0507 12:55:36.414048 1 diskrecorder.go:51] Wrote 101 records to disk in 5ms I0507 12:55:36.414076 1 periodic.go:285] Gathering cluster info every 2h0m0s I0507 12:55:36.414092 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0507 12:55:36.825653 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 12:55:37.029870 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 12:55:47.242430 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 12:56:50.028317 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="690c5c3fbaf15032e2b3f6ef5d451f87f90b75cc9a8430a24b581a3033b5d8ab") W0507 12:56:50.028349 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0507 12:56:50.028400 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="eca9f69631110631d44e786fc2ca3fb4176be2e07f58ab8a574ad46eefdd0d3d") I0507 12:56:50.028408 1 base_controller.go:181] Shutting down ConfigController ... I0507 12:56:50.028408 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0507 12:56:50.028426 1 base_controller.go:181] Shutting down LoggingSyncer ... I0507 12:56:50.028438 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="9492b982d147847f5331ea9a08b6116b18b2d5316875f1b62100441955cbaed4") I0507 12:56:50.028440 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0507 12:56:50.028472 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0507 12:56:50.028487 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" E0507 12:56:50.028512 1 controller.go:341] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0507 12:56:50.028516 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0507 12:56:50.028523 1 base_controller.go:113] All ConfigController workers have been terminated I0507 12:56:50.028523 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0507 12:56:50.028531 1 periodic.go:177] Shutting down I0507 12:56:50.028543 1 secure_serving.go:258] Stopped listening on [::]:8443 I0507 12:56:50.028544 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0507 12:56:50.028553 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-2991498347/tls.crt::/tmp/serving-cert-2991498347/tls.key" I0507 12:56:50.028574 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController