W0406 02:57:34.022008 1 cmd.go:257] Using insecure, self-signed certificates I0406 02:57:34.628717 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0406 02:57:34.629048 1 observer_polling.go:159] Starting file observer I0406 02:57:34.978023 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0406 02:57:34.978226 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0406 02:57:34.978760 1 secure_serving.go:57] Forcing use of http/1.1 only W0406 02:57:34.978780 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0406 02:57:34.978784 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0406 02:57:34.978788 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0406 02:57:34.978790 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. I0406 02:57:34.978787 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0406 02:57:34.978793 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0406 02:57:34.978808 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0406 02:57:34.981947 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0406 02:57:34.981961 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"0941cb99-a2cd-4e25-bbee-3e9106f230ee", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0406 02:57:34.983030 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0406 02:57:34.983049 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0406 02:57:34.983045 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0406 02:57:34.983043 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0406 02:57:34.983063 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0406 02:57:34.983067 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0406 02:57:34.983253 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-4282913174/tls.crt::/tmp/serving-cert-4282913174/tls.key" I0406 02:57:34.983641 1 secure_serving.go:213] Serving securely on [::]:8443 I0406 02:57:34.983679 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0406 02:57:34.986574 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0406 02:57:34.986598 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0406 02:57:34.986693 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0406 02:57:34.991245 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0406 02:57:34.991265 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0406 02:57:34.994807 1 secretconfigobserver.go:119] support secret does not exist I0406 02:57:35.000414 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0406 02:57:35.004143 1 secretconfigobserver.go:119] support secret does not exist I0406 02:57:35.006063 1 recorder.go:161] Pruning old reports every 8h23m32s, max age is 288h0m0s I0406 02:57:35.010036 1 periodic.go:209] Running clusterconfig gatherer I0406 02:57:35.010038 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0406 02:57:35.010042 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0406 02:57:35.010055 1 insightsreport.go:296] Starting report retriever I0406 02:57:35.010058 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0406 02:57:35.010061 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0406 02:57:35.010077 1 tasks_processing.go:45] number of workers: 64 I0406 02:57:35.010112 1 tasks_processing.go:69] worker 63 listening for tasks. I0406 02:57:35.010119 1 tasks_processing.go:71] worker 63 working on mutating_webhook_configurations task. I0406 02:57:35.010141 1 tasks_processing.go:69] worker 31 listening for tasks. I0406 02:57:35.010150 1 tasks_processing.go:69] worker 47 listening for tasks. I0406 02:57:35.010153 1 tasks_processing.go:69] worker 0 listening for tasks. I0406 02:57:35.010158 1 tasks_processing.go:69] worker 40 listening for tasks. I0406 02:57:35.010160 1 tasks_processing.go:69] worker 39 listening for tasks. I0406 02:57:35.010162 1 tasks_processing.go:69] worker 1 listening for tasks. I0406 02:57:35.010167 1 tasks_processing.go:69] worker 2 listening for tasks. I0406 02:57:35.010163 1 tasks_processing.go:69] worker 41 listening for tasks. I0406 02:57:35.010174 1 tasks_processing.go:69] worker 36 listening for tasks. I0406 02:57:35.010171 1 tasks_processing.go:69] worker 42 listening for tasks. I0406 02:57:35.010176 1 tasks_processing.go:69] worker 43 listening for tasks. I0406 02:57:35.010178 1 tasks_processing.go:69] worker 17 listening for tasks. I0406 02:57:35.010175 1 tasks_processing.go:69] worker 35 listening for tasks. I0406 02:57:35.010181 1 tasks_processing.go:69] worker 44 listening for tasks. I0406 02:57:35.010182 1 tasks_processing.go:69] worker 18 listening for tasks. I0406 02:57:35.010188 1 tasks_processing.go:69] worker 19 listening for tasks. I0406 02:57:35.010185 1 tasks_processing.go:69] worker 45 listening for tasks. I0406 02:57:35.010190 1 tasks_processing.go:69] worker 46 listening for tasks. I0406 02:57:35.010194 1 tasks_processing.go:69] worker 34 listening for tasks. I0406 02:57:35.010191 1 tasks_processing.go:69] worker 16 listening for tasks. I0406 02:57:35.010200 1 tasks_processing.go:69] worker 38 listening for tasks. I0406 02:57:35.010195 1 tasks_processing.go:69] worker 37 listening for tasks. I0406 02:57:35.010205 1 tasks_processing.go:69] worker 26 listening for tasks. I0406 02:57:35.010199 1 tasks_processing.go:69] worker 20 listening for tasks. I0406 02:57:35.010208 1 tasks_processing.go:69] worker 24 listening for tasks. I0406 02:57:35.010210 1 tasks_processing.go:69] worker 48 listening for tasks. I0406 02:57:35.010189 1 tasks_processing.go:69] worker 33 listening for tasks. I0406 02:57:35.010184 1 tasks_processing.go:69] worker 32 listening for tasks. I0406 02:57:35.010216 1 tasks_processing.go:69] worker 52 listening for tasks. I0406 02:57:35.010217 1 tasks_processing.go:69] worker 11 listening for tasks. I0406 02:57:35.010199 1 tasks_processing.go:69] worker 25 listening for tasks. I0406 02:57:35.010222 1 tasks_processing.go:69] worker 53 listening for tasks. I0406 02:57:35.010222 1 tasks_processing.go:69] worker 29 listening for tasks. I0406 02:57:35.010226 1 tasks_processing.go:69] worker 12 listening for tasks. I0406 02:57:35.010224 1 tasks_processing.go:69] worker 50 listening for tasks. I0406 02:57:35.010228 1 tasks_processing.go:69] worker 54 listening for tasks. I0406 02:57:35.010204 1 tasks_processing.go:69] worker 23 listening for tasks. I0406 02:57:35.010206 1 tasks_processing.go:69] worker 55 listening for tasks. I0406 02:57:35.010235 1 tasks_processing.go:69] worker 21 listening for tasks. I0406 02:57:35.010237 1 tasks_processing.go:69] worker 60 listening for tasks. I0406 02:57:35.010240 1 tasks_processing.go:69] worker 62 listening for tasks. I0406 02:57:35.010240 1 tasks_processing.go:69] worker 30 listening for tasks. I0406 02:57:35.010240 1 tasks_processing.go:69] worker 56 listening for tasks. I0406 02:57:35.010250 1 tasks_processing.go:69] worker 6 listening for tasks. I0406 02:57:35.010244 1 tasks_processing.go:69] worker 14 listening for tasks. I0406 02:57:35.010210 1 tasks_processing.go:69] worker 27 listening for tasks. I0406 02:57:35.010256 1 tasks_processing.go:69] worker 8 listening for tasks. I0406 02:57:35.010257 1 tasks_processing.go:69] worker 5 listening for tasks. I0406 02:57:35.010261 1 tasks_processing.go:69] worker 58 listening for tasks. I0406 02:57:35.010206 1 tasks_processing.go:69] worker 9 listening for tasks. I0406 02:57:35.010216 1 tasks_processing.go:69] worker 51 listening for tasks. I0406 02:57:35.010215 1 tasks_processing.go:69] worker 28 listening for tasks. I0406 02:57:35.010217 1 tasks_processing.go:69] worker 3 listening for tasks. I0406 02:57:35.010220 1 tasks_processing.go:69] worker 49 listening for tasks. I0406 02:57:35.010232 1 tasks_processing.go:69] worker 61 listening for tasks. I0406 02:57:35.010233 1 tasks_processing.go:69] worker 59 listening for tasks. I0406 02:57:35.010237 1 tasks_processing.go:69] worker 13 listening for tasks. I0406 02:57:35.010228 1 tasks_processing.go:69] worker 22 listening for tasks. I0406 02:57:35.010210 1 tasks_processing.go:69] worker 10 listening for tasks. I0406 02:57:35.010242 1 tasks_processing.go:69] worker 57 listening for tasks. I0406 02:57:35.010245 1 tasks_processing.go:69] worker 15 listening for tasks. I0406 02:57:35.010223 1 tasks_processing.go:69] worker 4 listening for tasks. I0406 02:57:35.010259 1 tasks_processing.go:69] worker 7 listening for tasks. I0406 02:57:35.010322 1 tasks_processing.go:71] worker 39 working on storage_cluster task. I0406 02:57:35.010343 1 tasks_processing.go:71] worker 35 working on certificate_signing_requests task. I0406 02:57:35.010349 1 tasks_processing.go:71] worker 54 working on networks task. I0406 02:57:35.010349 1 tasks_processing.go:71] worker 50 working on cluster_apiserver task. I0406 02:57:35.010357 1 tasks_processing.go:71] worker 19 working on pod_network_connectivity_checks task. I0406 02:57:35.010359 1 tasks_processing.go:71] worker 36 working on container_runtime_configs task. I0406 02:57:35.010365 1 tasks_processing.go:71] worker 33 working on machines task. I0406 02:57:35.010368 1 tasks_processing.go:71] worker 48 working on ceph_cluster task. I0406 02:57:35.010375 1 tasks_processing.go:71] worker 24 working on validating_webhook_configurations task. I0406 02:57:35.010387 1 tasks_processing.go:71] worker 47 working on openstack_version task. I0406 02:57:35.010349 1 tasks_processing.go:71] worker 44 working on nodenetworkstates task. I0406 02:57:35.010413 1 tasks_processing.go:71] worker 53 working on qemu_kubevirt_launcher_logs task. I0406 02:57:35.010432 1 tasks_processing.go:71] worker 32 working on lokistack task. I0406 02:57:35.010447 1 tasks_processing.go:71] worker 0 working on infrastructures task. I0406 02:57:35.010501 1 tasks_processing.go:71] worker 31 working on tsdb_status task. I0406 02:57:35.010528 1 tasks_processing.go:71] worker 11 working on sap_datahubs task. I0406 02:57:35.010597 1 tasks_processing.go:71] worker 13 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0406 02:57:35.010687 1 tasks_processing.go:71] worker 57 working on silenced_alerts task. I0406 02:57:35.010359 1 tasks_processing.go:71] worker 52 working on nodenetworkconfigurationpolicies task. W0406 02:57:35.010716 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0406 02:57:35.010725 1 tasks_processing.go:71] worker 57 working on feature_gates task. I0406 02:57:35.010353 1 tasks_processing.go:71] worker 18 working on openshift_logging task. I0406 02:57:35.010743 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 21.629µs to process 0 records I0406 02:57:35.010522 1 tasks_processing.go:71] worker 29 working on version task. I0406 02:57:35.010526 1 tasks_processing.go:71] worker 12 working on schedulers task. I0406 02:57:35.010520 1 tasks_processing.go:71] worker 40 working on machine_sets task. I0406 02:57:35.010534 1 tasks_processing.go:71] worker 16 working on jaegers task. I0406 02:57:35.010538 1 tasks_processing.go:71] worker 45 working on nodes task. I0406 02:57:35.010534 1 tasks_processing.go:71] worker 43 working on image_pruners task. I0406 02:57:35.010537 1 tasks_processing.go:71] worker 42 working on storage_classes task. I0406 02:57:35.010542 1 tasks_processing.go:71] worker 46 working on openstack_dataplanenodesets task. I0406 02:57:35.010546 1 tasks_processing.go:71] worker 25 working on crds task. I0406 02:57:35.010546 1 tasks_processing.go:71] worker 34 working on oauths task. I0406 02:57:35.010550 1 tasks_processing.go:71] worker 37 working on olm_operators task. I0406 02:57:35.010558 1 tasks_processing.go:71] worker 58 working on machine_config_pools task. I0406 02:57:35.010553 1 tasks_processing.go:71] worker 38 working on service_accounts task. I0406 02:57:35.010344 1 tasks_processing.go:71] worker 20 working on authentication task. I0406 02:57:35.010561 1 tasks_processing.go:71] worker 23 working on sap_config task. I0406 02:57:35.010557 1 tasks_processing.go:71] worker 17 working on node_logs task. I0406 02:57:35.010565 1 tasks_processing.go:71] worker 55 working on config_maps task. I0406 02:57:35.010560 1 tasks_processing.go:71] worker 26 working on operators task. I0406 02:57:35.010569 1 tasks_processing.go:71] worker 21 working on dvo_metrics task. I0406 02:57:35.010565 1 tasks_processing.go:71] worker 2 working on metrics task. W0406 02:57:35.011858 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0406 02:57:35.011867 1 tasks_processing.go:74] worker 2 stopped. I0406 02:57:35.011875 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 19.715µs to process 0 records I0406 02:57:35.010572 1 tasks_processing.go:71] worker 60 working on install_plans task. I0406 02:57:35.010574 1 tasks_processing.go:71] worker 9 working on pdbs task. I0406 02:57:35.010567 1 tasks_processing.go:71] worker 1 working on machine_autoscalers task. I0406 02:57:35.010575 1 tasks_processing.go:71] worker 14 working on proxies task. I0406 02:57:35.010570 1 tasks_processing.go:71] worker 41 working on aggregated_monitoring_cr_names task. I0406 02:57:35.010575 1 tasks_processing.go:71] worker 6 working on cost_management_metrics_configs task. W0406 02:57:35.010564 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0406 02:57:35.010578 1 tasks_processing.go:71] worker 51 working on image_registries task. I0406 02:57:35.012175 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.62273ms to process 0 records I0406 02:57:35.010583 1 tasks_processing.go:71] worker 28 working on ingress task. I0406 02:57:35.010579 1 tasks_processing.go:71] worker 30 working on container_images task. I0406 02:57:35.010580 1 tasks_processing.go:71] worker 56 working on clusterroles task. I0406 02:57:35.010580 1 tasks_processing.go:71] worker 8 working on overlapping_namespace_uids task. I0406 02:57:35.010588 1 tasks_processing.go:71] worker 3 working on image task. I0406 02:57:35.010580 1 tasks_processing.go:71] worker 27 working on ingress_certificates task. I0406 02:57:35.010345 1 tasks_processing.go:71] worker 7 working on openshift_machine_api_events task. I0406 02:57:35.010590 1 tasks_processing.go:71] worker 15 working on support_secret task. I0406 02:57:35.010590 1 tasks_processing.go:71] worker 22 working on openstack_dataplanedeployments task. I0406 02:57:35.010586 1 tasks_processing.go:71] worker 5 working on machine_configs task. I0406 02:57:35.010584 1 tasks_processing.go:71] worker 62 working on operators_pods_and_events task. I0406 02:57:35.010596 1 tasks_processing.go:71] worker 10 working on monitoring_persistent_volumes task. I0406 02:57:35.010590 1 tasks_processing.go:71] worker 4 working on active_alerts task. I0406 02:57:35.010593 1 tasks_processing.go:71] worker 61 working on openstack_controlplanes task. W0406 02:57:35.012851 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0406 02:57:35.012865 1 tasks_processing.go:74] worker 4 stopped. I0406 02:57:35.010595 1 tasks_processing.go:71] worker 49 working on machine_healthchecks task. I0406 02:57:35.012875 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 27.436µs to process 0 records I0406 02:57:35.010594 1 tasks_processing.go:71] worker 59 working on sap_pods task. I0406 02:57:35.012165 1 tasks_processing.go:74] worker 31 stopped. I0406 02:57:35.013972 1 tasks_processing.go:74] worker 19 stopped. E0406 02:57:35.013984 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0406 02:57:35.013991 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 3.607656ms to process 0 records I0406 02:57:35.013997 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 3.596688ms to process 0 records I0406 02:57:35.014001 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 3.583558ms to process 0 records I0406 02:57:35.014004 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 3.547446ms to process 0 records I0406 02:57:35.014007 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 3.634076ms to process 0 records I0406 02:57:35.014011 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 3.610796ms to process 0 records I0406 02:57:35.014013 1 tasks_processing.go:74] worker 44 stopped. I0406 02:57:35.014020 1 tasks_processing.go:74] worker 48 stopped. I0406 02:57:35.014065 1 tasks_processing.go:74] worker 36 stopped. I0406 02:57:35.014198 1 tasks_processing.go:74] worker 32 stopped. I0406 02:57:35.014224 1 tasks_processing.go:74] worker 47 stopped. I0406 02:57:35.021125 1 tasks_processing.go:74] worker 40 stopped. I0406 02:57:35.021139 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 10.30827ms to process 0 records I0406 02:57:35.021147 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 10.794226ms to process 0 records I0406 02:57:35.021151 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 10.02177ms to process 0 records I0406 02:57:35.021158 1 tasks_processing.go:74] worker 46 stopped. I0406 02:57:35.021162 1 tasks_processing.go:74] worker 39 stopped. I0406 02:57:35.021241 1 tasks_processing.go:74] worker 18 stopped. I0406 02:57:35.021250 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 10.495847ms to process 0 records I0406 02:57:35.021271 1 tasks_processing.go:74] worker 16 stopped. I0406 02:57:35.021292 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 10.415584ms to process 0 records I0406 02:57:35.021344 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0406 02:57:35.021375 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0406 02:57:35.021386 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0406 02:57:35.021390 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0406 02:57:35.021411 1 controller.go:489] The operator is still being initialized I0406 02:57:35.021347 1 tasks_processing.go:74] worker 63 stopped. I0406 02:57:35.021422 1 controller.go:512] The operator is healthy I0406 02:57:35.021583 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=999f3c5ae58f3b8b2e32eaf2a4161027e1ec3b9c2d2cfb44cc1477f51bd50a11 I0406 02:57:35.021622 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=df976e4ae0b9f2501d9a009ae25ce92b87f9ca932f8ff173f57efc3c8497cfb0 I0406 02:57:35.021648 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=55dca8bc65f83bfaca6f281af91e6937db14463b14ca0ad0263a9ddd43bf5723 I0406 02:57:35.021656 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 11.157689ms to process 3 records E0406 02:57:35.021668 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0406 02:57:35.021678 1 gather.go:177] gatherer "clusterconfig" function "machines" took 10.989255ms to process 0 records I0406 02:57:35.021708 1 tasks_processing.go:74] worker 33 stopped. I0406 02:57:35.021782 1 tasks_processing.go:74] worker 50 stopped. I0406 02:57:35.021810 1 recorder.go:75] Recording config/apiserver with fingerprint=46e5b7872fa6e077150a27817ff198f59c2ca6bca18fee8f43847e40676c839d I0406 02:57:35.021820 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 11.191802ms to process 1 records I0406 02:57:35.024143 1 tasks_processing.go:74] worker 11 stopped. I0406 02:57:35.024158 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 13.530841ms to process 0 records I0406 02:57:35.024375 1 tasks_processing.go:74] worker 52 stopped. I0406 02:57:35.024391 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 13.664834ms to process 0 records I0406 02:57:35.024429 1 gather_logs.go:145] no pods in namespace were found I0406 02:57:35.024499 1 tasks_processing.go:74] worker 0 stopped. I0406 02:57:35.024939 1 recorder.go:75] Recording config/infrastructure with fingerprint=718f76d1c497fd7e132775d1a8dd2aab89bcfebeb4d309abe7bc38699e3ad505 I0406 02:57:35.024951 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 13.933859ms to process 1 records I0406 02:57:35.024961 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 14.017172ms to process 0 records I0406 02:57:35.024975 1 tasks_processing.go:74] worker 53 stopped. I0406 02:57:35.025004 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=4d222af8cd48b2adb715c21120d6ee2fcfe6a8a6ef0c7bacf30de3f22e26db0d I0406 02:57:35.025011 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 13.829501ms to process 1 records I0406 02:57:35.025044 1 tasks_processing.go:74] worker 12 stopped. I0406 02:57:35.025091 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=7e1dee376992c3f75144aeb06afb3095f0396e1798c68eb02b504be8aab5c54d I0406 02:57:35.025110 1 tasks_processing.go:74] worker 24 stopped. I0406 02:57:35.025163 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=eb316134eed404e3767b809c833d0225608264684b60dab8a148bc59ad237cb9 I0406 02:57:35.025180 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=9858eb7de03ab0d82f4ed3835236822e902e728f5714bcd721e9013f990ac5b2 I0406 02:57:35.025203 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=b70a56b1ac9ff9762cfd4cf122dadc35f9bf42b74d31dd9ecd7689618189af14 I0406 02:57:35.025226 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=26922e8ae39533243805f55094181d92641597ef838429c9be759a015a79a592 I0406 02:57:35.025249 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=adeb8bef1fac679238a6ba7445b03a81837a9d3bfb15d20d1bfa9dc1ee1e9549 I0406 02:57:35.025272 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=b6267937fb5b712d2b6f6322ba0890239521283e13bd1a134b8c82636b7d9f9a I0406 02:57:35.025304 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=2c7a9c024352b38f4be924122f063624271a6d44a797bbf03c61f90e587fe682 I0406 02:57:35.025343 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=48fbca6f1b70b708c1b977753a0c6620252a7fa1d81ec5a858feb8e4b400d35d I0406 02:57:35.025370 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=ba0e25fc20339113087b1336d6d273b3111fff6c3ea8419d9af799c1de8cf309 I0406 02:57:35.025394 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=a41a74ab044d234e888dd3a705f7f8c1a718a8bdb7b30de9c4edb3521d892712 I0406 02:57:35.025400 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 14.276285ms to process 11 records I0406 02:57:35.025479 1 tasks_processing.go:74] worker 54 stopped. I0406 02:57:35.025515 1 recorder.go:75] Recording config/network with fingerprint=9e63407e99152bd474096eab5856778f21d9169cb4e2e052c595b5a08c87432d I0406 02:57:35.025523 1 gather.go:177] gatherer "clusterconfig" function "networks" took 14.425675ms to process 1 records I0406 02:57:35.025600 1 tasks_processing.go:74] worker 43 stopped. I0406 02:57:35.025683 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=5478e0db31a9b402a293b148d38fc67701fd76cc00d4ecb378e444eed7ba85f5 I0406 02:57:35.025691 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 13.800233ms to process 1 records I0406 02:57:35.026504 1 tasks_processing.go:74] worker 34 stopped. I0406 02:57:35.026698 1 recorder.go:75] Recording config/oauth with fingerprint=2003be6a4a8e0bc1fe5687103b6bcba75dd217abff0b9009ec269f4c9c8c94f6 I0406 02:57:35.026715 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 15.220807ms to process 1 records I0406 02:57:35.027122 1 tasks_processing.go:74] worker 42 stopped. I0406 02:57:35.027233 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=ce04e0e8b7f3bc00135efb1e141fc1f06de8fc19bc057ce291dcfd51ba359929 I0406 02:57:35.027259 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=aac1baacd9030d4eb103641d1a5a9e42305e028d7b55301102a5852aed351ddd I0406 02:57:35.027272 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 16.033484ms to process 2 records I0406 02:57:35.027285 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 15.911516ms to process 0 records I0406 02:57:35.027294 1 tasks_processing.go:74] worker 37 stopped. I0406 02:57:35.028023 1 tasks_processing.go:74] worker 35 stopped. I0406 02:57:35.028034 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 17.665325ms to process 0 records I0406 02:57:35.031433 1 tasks_processing.go:74] worker 61 stopped. I0406 02:57:35.031449 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 18.57799ms to process 0 records I0406 02:57:35.031512 1 tasks_processing.go:74] worker 1 stopped. I0406 02:57:35.031520 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 19.568173ms to process 0 records I0406 02:57:35.036688 1 tasks_processing.go:74] worker 22 stopped. I0406 02:57:35.036706 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 24.058689ms to process 0 records I0406 02:57:35.036733 1 tasks_processing.go:74] worker 59 stopped. I0406 02:57:35.036743 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 23.813861ms to process 0 records I0406 02:57:35.036813 1 tasks_processing.go:74] worker 6 stopped. I0406 02:57:35.036819 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 24.690859ms to process 0 records I0406 02:57:35.036844 1 tasks_processing.go:74] worker 7 stopped. I0406 02:57:35.036861 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 24.353486ms to process 0 records I0406 02:57:35.036875 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 25.28214ms to process 0 records I0406 02:57:35.036883 1 tasks_processing.go:74] worker 23 stopped. I0406 02:57:35.036890 1 tasks_processing.go:74] worker 49 stopped. E0406 02:57:35.036898 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0406 02:57:35.036904 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 24.01118ms to process 0 records I0406 02:57:35.036963 1 recorder.go:75] Recording config/proxy with fingerprint=24a3c83bae660afc1af238ff91ed457e57736e02b48ef08fe3c3271b2544916c I0406 02:57:35.036974 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 24.87344ms to process 1 records I0406 02:57:35.037016 1 tasks_processing.go:74] worker 14 stopped. I0406 02:57:35.037060 1 recorder.go:75] Recording config/featuregate with fingerprint=c4b65c69aa26eb54fd118f51ee6935bcf31b2fa3d14b453dbe62d24e998f7404 I0406 02:57:35.037070 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 26.227012ms to process 1 records I0406 02:57:35.037076 1 tasks_processing.go:74] worker 57 stopped. I0406 02:57:35.037127 1 tasks_processing.go:74] worker 20 stopped. I0406 02:57:35.037284 1 recorder.go:75] Recording config/authentication with fingerprint=74f9d02dde5f2643a9ea916a5192730c960a14008c72b69d2ffb8dfb428ce9de I0406 02:57:35.037296 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 25.633805ms to process 1 records I0406 02:57:35.038300 1 tasks_processing.go:74] worker 25 stopped. I0406 02:57:35.039477 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=8b94099ef8fb94ae1799afe420d655e91d85d92446dc4240a97bf0dc3b88b4f4 I0406 02:57:35.039679 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=378338e222dff263fdf4efd6575e876af0e70723c06d7be26c98ce48b493c033 I0406 02:57:35.039689 1 gather.go:177] gatherer "clusterconfig" function "crds" took 27.096535ms to process 2 records I0406 02:57:35.039780 1 tasks_processing.go:74] worker 28 stopped. I0406 02:57:35.039790 1 recorder.go:75] Recording config/ingress with fingerprint=1d4b1828c95e769cdb884649bf4c56fb5e67ff18c8ebe66ff942f74069e39379 I0406 02:57:35.039797 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 26.403187ms to process 1 records I0406 02:57:35.042712 1 tasks_processing.go:74] worker 9 stopped. I0406 02:57:35.042809 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=6b8ffdb129bd36e478f44b0faf36e065d28e01f2a73f5c439acba7a4b6786081 I0406 02:57:35.042857 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=42aa69cf02e76445ba7cd8a91bb460152c261987a933fbcd545adc1c7cd236d3 I0406 02:57:35.042887 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=e4c4fc49c5dcdb2858bc56c3f351e430dc4930f7bdad1cb21ac11fb9ffaa073a I0406 02:57:35.042900 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 30.788608ms to process 3 records I0406 02:57:35.044158 1 tasks_processing.go:74] worker 3 stopped. I0406 02:57:35.044236 1 recorder.go:75] Recording config/image with fingerprint=a85d495f71827c9dfe83198410497425cee644155a7632eb4a6418041b2990a0 I0406 02:57:35.044249 1 gather.go:177] gatherer "clusterconfig" function "image" took 31.802098ms to process 1 records I0406 02:57:35.044447 1 tasks_processing.go:74] worker 17 stopped. I0406 02:57:35.044471 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 32.791962ms to process 0 records I0406 02:57:35.044584 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0406 02:57:35.044610 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0406 02:57:35.044621 1 tasks_processing.go:74] worker 10 stopped. I0406 02:57:35.044633 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 31.879983ms to process 0 records W0406 02:57:35.044999 1 operator.go:288] started I0406 02:57:35.045019 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0406 02:57:35.045088 1 tasks_processing.go:74] worker 51 stopped. I0406 02:57:35.045932 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=c15a0353d6cdd2d689854ae29a91b3f789c5a898020ba88276cd557643a51659 I0406 02:57:35.046000 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 32.9015ms to process 1 records E0406 02:57:35.046034 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0406 02:57:35.046062 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 32.939ms to process 0 records I0406 02:57:35.046103 1 tasks_processing.go:74] worker 15 stopped. I0406 02:57:35.046203 1 tasks_processing.go:74] worker 45 stopped. I0406 02:57:35.046807 1 recorder.go:75] Recording config/node/ip-10-0-0-211.ec2.internal with fingerprint=a4a93a90b9efd2a71c14f1547b6ebda93979461c8b6f737dc3af1a84c1c7d5dd I0406 02:57:35.046925 1 recorder.go:75] Recording config/node/ip-10-0-1-222.ec2.internal with fingerprint=a61ddcc99a29d73cf3f590d8576202bc87f3d09c60f98b22348a7fa09a67e2f8 I0406 02:57:35.047008 1 recorder.go:75] Recording config/node/ip-10-0-2-127.ec2.internal with fingerprint=4f27932e8eeb9372084b6fa4aef23a4346f6becd286a157e0604f7968973ff4b I0406 02:57:35.047017 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 35.126292ms to process 3 records I0406 02:57:35.050136 1 tasks_processing.go:74] worker 56 stopped. W0406 02:57:35.050144 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0406 02:57:35.050287 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=95893aa2102426f86e9749965fda32872b7adf1d897f8dade0d438582dcd9264 I0406 02:57:35.050379 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=e2d7f9b3819ff4b7a071b98c470db9179f48418c1c72d94a58e2803db623373a I0406 02:57:35.050388 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 37.81503ms to process 2 records I0406 02:57:35.050422 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0406 02:57:35.050436 1 controller.go:212] Source scaController *sca.Controller is not ready I0406 02:57:35.050440 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0406 02:57:35.050442 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0406 02:57:35.050445 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0406 02:57:35.050462 1 controller.go:489] The operator is still being initialized I0406 02:57:35.050470 1 controller.go:512] The operator is healthy I0406 02:57:35.051346 1 tasks_processing.go:74] worker 13 stopped. I0406 02:57:35.051361 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 40.680414ms to process 0 records I0406 02:57:35.052741 1 tasks_processing.go:74] worker 5 stopped. I0406 02:57:35.052770 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0406 02:57:35.052784 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 40.081498ms to process 1 records I0406 02:57:35.058827 1 prometheus_rules.go:88] Prometheus rules successfully created I0406 02:57:35.059478 1 tasks_processing.go:74] worker 41 stopped. I0406 02:57:35.059497 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 47.375543ms to process 0 records E0406 02:57:35.060239 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2741fefd70-2811-4dde-b29a-2438e6b95667%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:33896->172.30.0.10:53: read: connection refused I0406 02:57:35.060250 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2741fefd70-2811-4dde-b29a-2438e6b95667%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:33896->172.30.0.10:53: read: connection refused I0406 02:57:35.068279 1 tasks_processing.go:74] worker 27 stopped. E0406 02:57:35.068295 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0406 02:57:35.068302 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pgcu9cjfg9shaota3dkgsk9ekr7c59h-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pgcu9cjfg9shaota3dkgsk9ekr7c59h-primary-cert-bundle-secret" not found I0406 02:57:35.068376 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=58ae2b5358042e1477e9273f0b458a20334d6c6699e22e91dfbc80bc14d5cfb1 I0406 02:57:35.068389 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 55.800156ms to process 1 records I0406 02:57:35.068660 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0406 02:57:35.071090 1 tasks_processing.go:74] worker 55 stopped. E0406 02:57:35.071102 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0406 02:57:35.071107 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0406 02:57:35.071111 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0406 02:57:35.071119 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0406 02:57:35.071142 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0406 02:57:35.071149 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0406 02:57:35.071153 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0406 02:57:35.071157 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0406 02:57:35.071193 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0406 02:57:35.071200 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0406 02:57:35.071206 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 59.414444ms to process 7 records W0406 02:57:35.072169 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:46574->172.30.0.10:53: read: connection refused I0406 02:57:35.072179 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:46574->172.30.0.10:53: read: connection refused I0406 02:57:35.084090 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0406 02:57:35.084098 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0406 02:57:35.084177 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0406 02:57:35.086837 1 base_controller.go:82] Caches are synced for ConfigController I0406 02:57:35.086847 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0406 02:57:35.090125 1 configmapobserver.go:84] configmaps "insights-config" not found I0406 02:57:35.121658 1 tasks_processing.go:74] worker 29 stopped. I0406 02:57:35.121902 1 recorder.go:75] Recording config/version with fingerprint=c1f6f3bba94384ca15df35652bb7d3fcc4a8c31c51b213a8ce06a1b6965f3186 I0406 02:57:35.121915 1 recorder.go:75] Recording config/id with fingerprint=84cd4d645017f614ad73a154a499e84bd695818e2cea8831adfd84fec120489b I0406 02:57:35.121921 1 gather.go:177] gatherer "clusterconfig" function "version" took 110.869334ms to process 2 records I0406 02:57:35.134561 1 tasks_processing.go:74] worker 30 stopped. I0406 02:57:35.134620 1 recorder.go:75] Recording config/running_containers with fingerprint=ff232b2844dabb88a630110583cb4989743af5c080056876c6b0b599f7ea47d3 I0406 02:57:35.134632 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 122.242748ms to process 1 records I0406 02:57:35.138489 1 tasks_processing.go:74] worker 8 stopped. I0406 02:57:35.138516 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0406 02:57:35.138527 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 126.143121ms to process 1 records I0406 02:57:35.138552 1 tasks_processing.go:74] worker 58 stopped. I0406 02:57:35.138567 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 127.109502ms to process 0 records I0406 02:57:35.145496 1 base_controller.go:82] Caches are synced for LoggingSyncer I0406 02:57:35.145511 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0406 02:57:35.452860 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0406 02:57:35.452872 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0406 02:57:35.453155 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-2lf9r pod in namespace openshift-dns (previous: false). I0406 02:57:35.680228 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2lf9r pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-2lf9r\" is waiting to start: ContainerCreating" I0406 02:57:35.680246 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-2lf9r\" is waiting to start: ContainerCreating" I0406 02:57:35.680254 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-2lf9r pod in namespace openshift-dns (previous: false). I0406 02:57:35.858774 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2lf9r pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-2lf9r\" is waiting to start: ContainerCreating" I0406 02:57:35.858797 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-2lf9r\" is waiting to start: ContainerCreating" I0406 02:57:35.858808 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-7stng pod in namespace openshift-dns (previous: false). W0406 02:57:36.047926 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0406 02:57:36.082431 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7stng pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-7stng\" is waiting to start: ContainerCreating" I0406 02:57:36.082448 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-7stng\" is waiting to start: ContainerCreating" I0406 02:57:36.082455 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-7stng pod in namespace openshift-dns (previous: false). I0406 02:57:36.256863 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7stng pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-7stng\" is waiting to start: ContainerCreating" I0406 02:57:36.256877 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-7stng\" is waiting to start: ContainerCreating" I0406 02:57:36.256888 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-rggc6 pod in namespace openshift-dns (previous: false). I0406 02:57:36.462193 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0406 02:57:36.478631 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-rggc6 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-rggc6\" is waiting to start: ContainerCreating" I0406 02:57:36.478645 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-rggc6\" is waiting to start: ContainerCreating" I0406 02:57:36.478652 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-rggc6 pod in namespace openshift-dns (previous: false). I0406 02:57:36.658426 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-rggc6 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-rggc6\" is waiting to start: ContainerCreating" I0406 02:57:36.658439 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-rggc6\" is waiting to start: ContainerCreating" I0406 02:57:36.658448 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-6btxs pod in namespace openshift-dns (previous: false). I0406 02:57:36.864567 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0406 02:57:36.864584 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-fg6q9 pod in namespace openshift-dns (previous: false). I0406 02:57:36.869221 1 tasks_processing.go:74] worker 26 stopped. I0406 02:57:36.869276 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=26881a2656fafb3a601e545b2bf599ccc9137a121a2ff03daaa9c3853cc1d681 I0406 02:57:36.869309 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=518968941f66cb6c10f714c2156d0540d9f3aed7bb3a2ac86f2002586f5551ac I0406 02:57:36.869357 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0406 02:57:36.869387 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=efd51d069cd2441b69fbdefa98f4a44a7d2cf47dacc202824f59b17d6629ea47 I0406 02:57:36.869404 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0406 02:57:36.869427 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=1554e25ca041579a12d0ca161b8ab9b484e9bb5d773562b190a25f1800b09fac I0406 02:57:36.869471 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=228add2332e5c74b3e7aad80a784e5e9cd3f973a6cbf46179d16cc14160c1b90 I0406 02:57:36.869495 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=5e2cd3cbccd495ebef2dfad31f203bec4ee38524748defddcd685fc5372d7df5 I0406 02:57:36.869511 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=b4345f4b76c369cd2b675536b0fca5244a095298dd127369ef82854e569f489c I0406 02:57:36.869530 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=94d2dad256bb4b6f0263b200194c39e5f5a8c95ed295cf0611eacbdd2722e841 I0406 02:57:36.869539 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0406 02:57:36.869555 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=6b141a2707231db0bdd88c9f1a943e25e57db0d0c6dbac5e661b95b1d65fdc6e I0406 02:57:36.869566 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0406 02:57:36.869581 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=182c7eb665ffffd199bd020ee7b7b45f50ad2d217c96cb0b394fa77fe06f7587 I0406 02:57:36.869590 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0406 02:57:36.869603 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=6e4fe78220f4c86dbf5bcbb73f2d54718d3e86b222e0e2c6edbaa50f82dc142e I0406 02:57:36.869613 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0406 02:57:36.869628 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=c82be0a6ebc025233f745e5a655f8ab17a0256dfa3b4cb0995c43cc735c61951 I0406 02:57:36.869749 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=b7f498668ea2e7843a79a256472383bc2106d8e7fa770a2954912009034654c4 I0406 02:57:36.869759 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0406 02:57:36.869765 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0406 02:57:36.869784 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0406 02:57:36.869805 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=79cab88e405f078b1f52f83efa58eb56043471fb8e1cc013cae99f86643b9411 I0406 02:57:36.869828 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=bdad7ee8254314c8ac5b894ea83baafb21adee7d24e3d48d651fffc2e67db12c I0406 02:57:36.869837 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0406 02:57:36.869852 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=0ca1a9442bbbd54e5656fb5c223a508433f641b4c388a732d7b06b3db39f7cee I0406 02:57:36.869861 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0406 02:57:36.869874 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=eaef53af1360eca03e9373ff5cc5dd31d61965bfcf59518f8f79fc216cb8bfc5 I0406 02:57:36.869888 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=eddaf7421116244e26a075aca0c453501945005f56439338d092270a47e6e691 I0406 02:57:36.869904 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=dcdb2c7883f39766747374650e55e1a23aefae91fd4e4076da9ad47531293ea7 I0406 02:57:36.869919 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=e3d7d0326e19f7478f577a8447469924299b94d4376126b45295e77155bef76a I0406 02:57:36.869934 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=db849bc16de1d499aeba6a4bc9743e619b502db985220b2b5a3929cdfabf7d71 I0406 02:57:36.869960 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=1bf4ac10a4e1f15230c3977261bda795f4b23d975c6ad061391e15816fb348e6 I0406 02:57:36.869976 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0406 02:57:36.869985 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0406 02:57:36.869991 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.857512922s to process 35 records W0406 02:57:37.048269 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0406 02:57:37.057168 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0406 02:57:37.057183 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-grwmp pod in namespace openshift-dns (previous: false). I0406 02:57:37.258102 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0406 02:57:37.258155 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6978bb8f59-x86vm pod in namespace openshift-image-registry (previous: false). I0406 02:57:37.458674 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6978bb8f59-x86vm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6978bb8f59-x86vm\" is waiting to start: ContainerCreating" I0406 02:57:37.458690 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6978bb8f59-x86vm\" is waiting to start: ContainerCreating" I0406 02:57:37.458734 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-74f879596d-8bjpg pod in namespace openshift-image-registry (previous: false). I0406 02:57:37.666139 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-74f879596d-8bjpg pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-74f879596d-8bjpg\" is waiting to start: ContainerCreating" I0406 02:57:37.666154 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-74f879596d-8bjpg\" is waiting to start: ContainerCreating" I0406 02:57:37.666199 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-74f879596d-nsjvm pod in namespace openshift-image-registry (previous: false). I0406 02:57:37.862083 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-74f879596d-nsjvm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-74f879596d-nsjvm\" is waiting to start: ContainerCreating" I0406 02:57:37.862098 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-74f879596d-nsjvm\" is waiting to start: ContainerCreating" I0406 02:57:37.862107 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-b8db8 pod in namespace openshift-image-registry (previous: false). W0406 02:57:38.048365 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0406 02:57:38.057587 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0406 02:57:38.057602 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-dmv9l pod in namespace openshift-image-registry (previous: false). I0406 02:57:38.258495 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0406 02:57:38.258511 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-rdk95 pod in namespace openshift-image-registry (previous: false). I0406 02:57:38.458198 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0406 02:57:38.458215 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-844c5ccb97-vgl7k pod in namespace openshift-ingress (previous: false). I0406 02:57:38.658424 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-844c5ccb97-vgl7k pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-844c5ccb97-vgl7k\" is waiting to start: ContainerCreating" I0406 02:57:38.658440 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-844c5ccb97-vgl7k\" is waiting to start: ContainerCreating" I0406 02:57:38.658453 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-d57b64f76-chq78 pod in namespace openshift-ingress (previous: false). I0406 02:57:38.857190 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-d57b64f76-chq78 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-d57b64f76-chq78\" is waiting to start: ContainerCreating" I0406 02:57:38.857206 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-d57b64f76-chq78\" is waiting to start: ContainerCreating" I0406 02:57:38.857219 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-d57b64f76-ndstt pod in namespace openshift-ingress (previous: false). W0406 02:57:39.048242 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0406 02:57:39.057624 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-d57b64f76-ndstt pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-d57b64f76-ndstt\" is waiting to start: ContainerCreating" I0406 02:57:39.057638 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-d57b64f76-ndstt\" is waiting to start: ContainerCreating" I0406 02:57:39.057651 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5sbc8 pod in namespace openshift-ingress-canary (previous: false). I0406 02:57:39.258425 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-5sbc8 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5sbc8\" is waiting to start: ContainerCreating" I0406 02:57:39.258440 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5sbc8\" is waiting to start: ContainerCreating" I0406 02:57:39.258452 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8ctkg pod in namespace openshift-ingress-canary (previous: false). I0406 02:57:39.458380 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-8ctkg pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8ctkg\" is waiting to start: ContainerCreating" I0406 02:57:39.458397 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8ctkg\" is waiting to start: ContainerCreating" I0406 02:57:39.458411 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-zdxrb pod in namespace openshift-ingress-canary (previous: false). I0406 02:57:39.659237 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-zdxrb pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-zdxrb\" is waiting to start: ContainerCreating" I0406 02:57:39.659255 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-zdxrb\" is waiting to start: ContainerCreating" I0406 02:57:39.659276 1 tasks_processing.go:74] worker 62 stopped. I0406 02:57:39.659387 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=61a1f1b6c1db9148b4eabd0ec998b468bb4d6ebe9e5956bd6e19aa4d5b0630ca I0406 02:57:39.659450 1 recorder.go:75] Recording events/openshift-dns with fingerprint=bcfef8611ac30fbc45c9c9fc0438d8cc0955796d4e18348cb174bb9b54604a58 I0406 02:57:39.659602 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=604a86b5134411ecf2b46e38d338146c6f90fcc15e8d66ef53db73e43388d1b9 I0406 02:57:39.659644 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=21a7ce20f09b6c77e88c7487930dd430462038401536c1ebbfd35fc6761395cf I0406 02:57:39.659709 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=8cc377add1f121e2c1ced8cfbb80376c0778aee23bda84dfe4fcb0b7545bb587 I0406 02:57:39.659738 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=9daffd0f896344fb761545afad77e95d1407f93751d823f9cf1ee8f6b21b4cdf I0406 02:57:39.661060 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6978bb8f59-x86vm with fingerprint=1d831ebd48a586627ccb0b422b684e2881b046691d968d9c66cfbd1bd7586b5f I0406 02:57:39.661199 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-74f879596d-8bjpg with fingerprint=237df30d556c2f8db4c728f84893637b3e2c11963fa068185337b13a0bd35d90 I0406 02:57:39.661310 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-74f879596d-nsjvm with fingerprint=d58f96b686ac4e25620c44651e972aa5172371299545be7f7446d06a8583e7cf I0406 02:57:39.661340 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.646543127s to process 9 records W0406 02:57:40.044704 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded E0406 02:57:40.044736 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0406 02:57:40.044748 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0406 02:57:40.044750 1 tasks_processing.go:74] worker 21 stopped. W0406 02:57:40.044761 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0406 02:57:40.044771 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.032977727s to process 1 records I0406 02:57:47.450170 1 tasks_processing.go:74] worker 60 stopped. I0406 02:57:47.450216 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0406 02:57:47.450231 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.438272635s to process 1 records I0406 02:57:48.180969 1 configmapobserver.go:84] configmaps "insights-config" not found I0406 02:57:48.217411 1 tasks_processing.go:74] worker 38 stopped. I0406 02:57:48.217680 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=5f3315562ab922847b80910efb7b38b1b30885aa3cdda0895bd6e02e66f43fde I0406 02:57:48.217696 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.205933567s to process 1 records E0406 02:57:48.217757 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.207s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0406 02:57:48.218867 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0406 02:57:48.218880 1 periodic.go:209] Running workloads gatherer I0406 02:57:48.218895 1 tasks_processing.go:45] number of workers: 2 I0406 02:57:48.218901 1 tasks_processing.go:69] worker 1 listening for tasks. I0406 02:57:48.218905 1 tasks_processing.go:71] worker 1 working on workload_info task. I0406 02:57:48.218912 1 tasks_processing.go:69] worker 0 listening for tasks. I0406 02:57:48.218924 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0406 02:57:48.240848 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0406 02:57:48.249069 1 tasks_processing.go:74] worker 0 stopped. I0406 02:57:48.249086 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.13176ms to process 0 records I0406 02:57:48.249455 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (9ms) I0406 02:57:48.257540 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0406 02:57:48.266078 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0406 02:57:48.273467 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (7ms) I0406 02:57:48.283633 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (10ms) I0406 02:57:48.291199 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (8ms) I0406 02:57:48.298985 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (8ms) I0406 02:57:48.307529 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (9ms) I0406 02:57:48.316639 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (9ms) I0406 02:57:48.325030 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (8ms) I0406 02:57:48.352114 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (27ms) I0406 02:57:48.450743 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0406 02:57:48.548642 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (98ms) I0406 02:57:48.649726 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (101ms) I0406 02:57:48.749752 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0406 02:57:48.849060 1 configmapobserver.go:84] configmaps "insights-config" not found I0406 02:57:48.849293 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0406 02:57:48.948088 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (99ms) I0406 02:57:49.048747 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (101ms) I0406 02:57:49.049171 1 configmapobserver.go:84] configmaps "insights-config" not found I0406 02:57:49.151202 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (102ms) I0406 02:57:49.248925 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (98ms) I0406 02:57:49.349368 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0406 02:57:49.448138 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (99ms) I0406 02:57:49.550236 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (102ms) I0406 02:57:49.648879 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (99ms) I0406 02:57:49.749392 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0406 02:57:49.848563 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (99ms) I0406 02:57:49.948319 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (100ms) I0406 02:57:50.049353 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (101ms) I0406 02:57:50.148568 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (99ms) I0406 02:57:50.249234 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (101ms) I0406 02:57:50.348227 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (99ms) I0406 02:57:50.448465 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0406 02:57:50.448494 1 tasks_processing.go:74] worker 1 stopped. E0406 02:57:50.448503 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0406 02:57:50.448783 1 recorder.go:75] Recording config/workload_info with fingerprint=c4235ec66a2a4fb11ef3675f81fbaf0aca41a26770472b584eeccb772dac995c I0406 02:57:50.448799 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.229581818s to process 1 records E0406 02:57:50.448831 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.229s with: function \"workload_info\" failed with an error" I0406 02:57:50.449933 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0406 02:57:50.449947 1 periodic.go:209] Running conditional gatherer I0406 02:57:50.454556 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0406 02:57:50.462399 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:45825->172.30.0.10:53: read: connection refused E0406 02:57:50.462623 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0406 02:57:50.462675 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0406 02:57:50.467249 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0406 02:57:50.467265 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0406 02:57:50.467271 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0406 02:57:50.467274 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0406 02:57:50.467277 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0406 02:57:50.467280 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0406 02:57:50.467283 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0406 02:57:50.467286 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0406 02:57:50.467289 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0406 02:57:50.467291 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0406 02:57:50.467304 1 tasks_processing.go:45] number of workers: 3 I0406 02:57:50.467323 1 tasks_processing.go:69] worker 2 listening for tasks. I0406 02:57:50.467347 1 tasks_processing.go:69] worker 0 listening for tasks. I0406 02:57:50.467356 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0406 02:57:50.467358 1 tasks_processing.go:69] worker 1 listening for tasks. I0406 02:57:50.467369 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I0406 02:57:50.467362 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0406 02:57:50.467439 1 tasks_processing.go:74] worker 1 stopped. I0406 02:57:50.467445 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0406 02:57:50.467455 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.105µs to process 1 records I0406 02:57:50.467485 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0406 02:57:50.467494 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 2.821µs to process 1 records I0406 02:57:50.467499 1 tasks_processing.go:74] worker 0 stopped. I0406 02:57:50.467586 1 tasks_processing.go:74] worker 2 stopped. I0406 02:57:50.467597 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 221.459µs to process 0 records I0406 02:57:50.467613 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:45825->172.30.0.10:53: read: connection refused I0406 02:57:50.467629 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0406 02:57:50.490910 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=fd17ccaefa6f0fd318b5721fccc4a3f3c820d481eb65b20af8b9c2767c5e730a I0406 02:57:50.491029 1 diskrecorder.go:70] Writing 102 records to /var/lib/insights-operator/insights-2026-04-06-025750.tar.gz I0406 02:57:50.497347 1 diskrecorder.go:51] Wrote 102 records to disk in 6ms I0406 02:57:50.497373 1 periodic.go:278] Gathering cluster info every 2h0m0s I0406 02:57:50.497389 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0406 02:58:01.798225 1 configmapobserver.go:84] configmaps "insights-config" not found I0406 02:58:54.629569 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="41504461921935df62ceeb5e86714e3186e4be5dc7a63b7ccfabdd15296815f4") W0406 02:58:54.629616 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0406 02:58:54.629691 1 base_controller.go:181] Shutting down LoggingSyncer ... I0406 02:58:54.629686 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0406 02:58:54.629705 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0406 02:58:54.629742 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0406 02:58:54.629780 1 periodic.go:170] Shutting down I0406 02:58:54.629805 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0406 02:58:54.629692 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="3950ba56934a0243ede0b89576bfcb74d290882056cdc075d52bf0761c6978df")