W0418 11:14:59.743414 1 cmd.go:257] Using insecure, self-signed certificates I0418 11:15:00.222841 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 11:15:00.223150 1 observer_polling.go:159] Starting file observer I0418 11:15:00.532506 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0418 11:15:00.533778 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0418 11:15:00.534349 1 secure_serving.go:57] Forcing use of http/1.1 only W0418 11:15:00.534369 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0418 11:15:00.534374 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0418 11:15:00.534377 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0418 11:15:00.534380 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0418 11:15:00.534383 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0418 11:15:00.534385 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0418 11:15:00.534600 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0418 11:15:00.538769 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0418 11:15:00.538772 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"00a2e435-a89f-4610-a553-c467b349d5ba", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0418 11:15:00.540529 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0418 11:15:00.540553 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0418 11:15:00.540543 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0418 11:15:00.540553 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0418 11:15:00.540580 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0418 11:15:00.540582 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0418 11:15:00.540824 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1291828849/tls.crt::/tmp/serving-cert-1291828849/tls.key" I0418 11:15:00.541096 1 secure_serving.go:213] Serving securely on [::]:8443 I0418 11:15:00.541132 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0418 11:15:00.547784 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0418 11:15:00.547814 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0418 11:15:00.547858 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0418 11:15:00.553045 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0418 11:15:00.553069 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0418 11:15:00.558173 1 secretconfigobserver.go:119] support secret does not exist I0418 11:15:00.563493 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0418 11:15:00.569145 1 secretconfigobserver.go:119] support secret does not exist I0418 11:15:00.571970 1 recorder.go:161] Pruning old reports every 7h2m14s, max age is 288h0m0s I0418 11:15:00.577963 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0418 11:15:00.577977 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0418 11:15:00.577985 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0418 11:15:00.577988 1 insightsreport.go:296] Starting report retriever I0418 11:15:00.578003 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0418 11:15:00.578027 1 periodic.go:209] Running clusterconfig gatherer I0418 11:15:00.578088 1 tasks_processing.go:45] number of workers: 64 I0418 11:15:00.578114 1 tasks_processing.go:69] worker 2 listening for tasks. I0418 11:15:00.578127 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 11:15:00.578139 1 tasks_processing.go:69] worker 14 listening for tasks. I0418 11:15:00.578141 1 tasks_processing.go:71] worker 0 working on storage_cluster task. I0418 11:15:00.578148 1 tasks_processing.go:71] worker 14 working on lokistack task. I0418 11:15:00.578154 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 11:15:00.578151 1 tasks_processing.go:69] worker 15 listening for tasks. I0418 11:15:00.578162 1 tasks_processing.go:69] worker 11 listening for tasks. I0418 11:15:00.578158 1 tasks_processing.go:69] worker 8 listening for tasks. I0418 11:15:00.578166 1 tasks_processing.go:69] worker 16 listening for tasks. I0418 11:15:00.578171 1 tasks_processing.go:69] worker 3 listening for tasks. I0418 11:15:00.578173 1 tasks_processing.go:69] worker 17 listening for tasks. I0418 11:15:00.578180 1 tasks_processing.go:69] worker 9 listening for tasks. I0418 11:15:00.578180 1 tasks_processing.go:69] worker 45 listening for tasks. I0418 11:15:00.578186 1 tasks_processing.go:69] worker 4 listening for tasks. I0418 11:15:00.578188 1 tasks_processing.go:69] worker 23 listening for tasks. I0418 11:15:00.578184 1 tasks_processing.go:69] worker 12 listening for tasks. I0418 11:15:00.578195 1 tasks_processing.go:69] worker 27 listening for tasks. I0418 11:15:00.578190 1 tasks_processing.go:69] worker 10 listening for tasks. I0418 11:15:00.578180 1 tasks_processing.go:69] worker 22 listening for tasks. I0418 11:15:00.578203 1 tasks_processing.go:69] worker 55 listening for tasks. I0418 11:15:00.578196 1 tasks_processing.go:69] worker 5 listening for tasks. I0418 11:15:00.578207 1 tasks_processing.go:69] worker 25 listening for tasks. I0418 11:15:00.578196 1 tasks_processing.go:69] worker 24 listening for tasks. I0418 11:15:00.578212 1 tasks_processing.go:69] worker 29 listening for tasks. I0418 11:15:00.578211 1 tasks_processing.go:69] worker 7 listening for tasks. I0418 11:15:00.578215 1 tasks_processing.go:69] worker 18 listening for tasks. I0418 11:15:00.578221 1 tasks_processing.go:69] worker 47 listening for tasks. I0418 11:15:00.578218 1 tasks_processing.go:69] worker 19 listening for tasks. I0418 11:15:00.578250 1 tasks_processing.go:69] worker 53 listening for tasks. I0418 11:15:00.578220 1 tasks_processing.go:69] worker 52 listening for tasks. I0418 11:15:00.578247 1 tasks_processing.go:69] worker 50 listening for tasks. I0418 11:15:00.578257 1 tasks_processing.go:69] worker 48 listening for tasks. I0418 11:15:00.578260 1 tasks_processing.go:69] worker 54 listening for tasks. I0418 11:15:00.578268 1 tasks_processing.go:69] worker 63 listening for tasks. I0418 11:15:00.578272 1 tasks_processing.go:69] worker 13 listening for tasks. I0418 11:15:00.578266 1 tasks_processing.go:69] worker 62 listening for tasks. I0418 11:15:00.578274 1 tasks_processing.go:69] worker 42 listening for tasks. I0418 11:15:00.578280 1 tasks_processing.go:69] worker 36 listening for tasks. I0418 11:15:00.578284 1 tasks_processing.go:69] worker 44 listening for tasks. I0418 11:15:00.578277 1 tasks_processing.go:69] worker 59 listening for tasks. I0418 11:15:00.578264 1 tasks_processing.go:69] worker 37 listening for tasks. I0418 11:15:00.578287 1 tasks_processing.go:69] worker 32 listening for tasks. I0418 11:15:00.578213 1 tasks_processing.go:69] worker 51 listening for tasks. I0418 11:15:00.578213 1 tasks_processing.go:69] worker 21 listening for tasks. I0418 11:15:00.578203 1 tasks_processing.go:69] worker 6 listening for tasks. I0418 11:15:00.578243 1 tasks_processing.go:69] worker 38 listening for tasks. I0418 11:15:00.578246 1 tasks_processing.go:69] worker 60 listening for tasks. I0418 11:15:00.578251 1 tasks_processing.go:69] worker 39 listening for tasks. I0418 11:15:00.578254 1 tasks_processing.go:69] worker 56 listening for tasks. I0418 11:15:00.578252 1 tasks_processing.go:69] worker 49 listening for tasks. I0418 11:15:00.578259 1 tasks_processing.go:69] worker 40 listening for tasks. I0418 11:15:00.578252 1 tasks_processing.go:69] worker 20 listening for tasks. I0418 11:15:00.578262 1 tasks_processing.go:69] worker 57 listening for tasks. I0418 11:15:00.578266 1 tasks_processing.go:69] worker 41 listening for tasks. I0418 11:15:00.578270 1 tasks_processing.go:69] worker 33 listening for tasks. I0418 11:15:00.578270 1 tasks_processing.go:69] worker 58 listening for tasks. I0418 11:15:00.578265 1 tasks_processing.go:69] worker 61 listening for tasks. I0418 11:15:00.578276 1 tasks_processing.go:69] worker 35 listening for tasks. I0418 11:15:00.578277 1 tasks_processing.go:69] worker 30 listening for tasks. I0418 11:15:00.578205 1 tasks_processing.go:69] worker 28 listening for tasks. I0418 11:15:00.578268 1 tasks_processing.go:69] worker 46 listening for tasks. I0418 11:15:00.578282 1 tasks_processing.go:69] worker 34 listening for tasks. I0418 11:15:00.578282 1 tasks_processing.go:69] worker 43 listening for tasks. I0418 11:15:00.578283 1 tasks_processing.go:69] worker 31 listening for tasks. I0418 11:15:00.578284 1 tasks_processing.go:71] worker 2 working on sap_pods task. I0418 11:15:00.578140 1 tasks_processing.go:69] worker 26 listening for tasks. I0418 11:15:00.578362 1 tasks_processing.go:71] worker 1 working on pod_network_connectivity_checks task. I0418 11:15:00.578363 1 tasks_processing.go:71] worker 15 working on storage_classes task. I0418 11:15:00.578365 1 tasks_processing.go:71] worker 11 working on tsdb_status task. I0418 11:15:00.578369 1 tasks_processing.go:71] worker 8 working on overlapping_namespace_uids task. I0418 11:15:00.578379 1 tasks_processing.go:71] worker 17 working on certificate_signing_requests task. I0418 11:15:00.578379 1 tasks_processing.go:71] worker 26 working on feature_gates task. W0418 11:15:00.578401 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 11:15:00.578416 1 tasks_processing.go:71] worker 11 working on openstack_dataplanedeployments task. I0418 11:15:00.578365 1 tasks_processing.go:71] worker 4 working on nodes task. I0418 11:15:00.578497 1 tasks_processing.go:71] worker 9 working on support_secret task. I0418 11:15:00.578583 1 tasks_processing.go:71] worker 23 working on openshift_logging task. I0418 11:15:00.578593 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 37.637µs to process 0 records I0418 11:15:00.578605 1 tasks_processing.go:71] worker 45 working on container_runtime_configs task. I0418 11:15:00.578704 1 tasks_processing.go:71] worker 59 working on openshift_machine_api_events task. I0418 11:15:00.578759 1 tasks_processing.go:71] worker 37 working on operators_pods_and_events task. I0418 11:15:00.578794 1 tasks_processing.go:71] worker 47 working on operators task. I0418 11:15:00.578804 1 tasks_processing.go:71] worker 54 working on machine_config_pools task. I0418 11:15:00.578373 1 tasks_processing.go:71] worker 3 working on image_registries task. I0418 11:15:00.578369 1 tasks_processing.go:71] worker 16 working on image task. I0418 11:15:00.578855 1 tasks_processing.go:71] worker 62 working on openstack_version task. I0418 11:15:00.578973 1 tasks_processing.go:71] worker 19 working on nodenetworkconfigurationpolicies task. I0418 11:15:00.578997 1 tasks_processing.go:71] worker 52 working on sap_config task. I0418 11:15:00.579006 1 tasks_processing.go:71] worker 5 working on sap_datahubs task. I0418 11:15:00.579025 1 tasks_processing.go:71] worker 63 working on mutating_webhook_configurations task. I0418 11:15:00.579033 1 tasks_processing.go:71] worker 25 working on nodenetworkstates task. I0418 11:15:00.579067 1 tasks_processing.go:71] worker 24 working on machine_autoscalers task. I0418 11:15:00.579117 1 tasks_processing.go:71] worker 42 working on metrics task. I0418 11:15:00.579132 1 tasks_processing.go:71] worker 50 working on ceph_cluster task. W0418 11:15:00.579141 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 11:15:00.579153 1 tasks_processing.go:74] worker 42 stopped. I0418 11:15:00.579164 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 24.996µs to process 0 records I0418 11:15:00.579172 1 tasks_processing.go:71] worker 36 working on monitoring_persistent_volumes task. I0418 11:15:00.579208 1 tasks_processing.go:71] worker 32 working on cost_management_metrics_configs task. I0418 11:15:00.579216 1 tasks_processing.go:71] worker 29 working on node_logs task. I0418 11:15:00.579251 1 tasks_processing.go:71] worker 12 working on cluster_apiserver task. I0418 11:15:00.579260 1 tasks_processing.go:71] worker 53 working on machines task. I0418 11:15:00.579276 1 tasks_processing.go:71] worker 13 working on oauths task. I0418 11:15:00.579296 1 tasks_processing.go:71] worker 48 working on crds task. I0418 11:15:00.579421 1 tasks_processing.go:71] worker 27 working on infrastructures task. I0418 11:15:00.579435 1 tasks_processing.go:71] worker 7 working on config_maps task. I0418 11:15:00.579456 1 tasks_processing.go:71] worker 51 working on image_pruners task. I0418 11:15:00.579466 1 tasks_processing.go:71] worker 44 working on jaegers task. I0418 11:15:00.579475 1 tasks_processing.go:71] worker 22 working on proxies task. I0418 11:15:00.579578 1 tasks_processing.go:71] worker 55 working on service_accounts task. I0418 11:15:00.579591 1 tasks_processing.go:71] worker 21 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0418 11:15:00.579613 1 tasks_processing.go:71] worker 10 working on ingress task. I0418 11:15:00.579624 1 tasks_processing.go:71] worker 6 working on silenced_alerts task. I0418 11:15:00.579632 1 tasks_processing.go:71] worker 18 working on ingress_certificates task. I0418 11:15:00.579639 1 tasks_processing.go:71] worker 56 working on schedulers task. W0418 11:15:00.579646 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 11:15:00.579657 1 tasks_processing.go:74] worker 6 stopped. I0418 11:15:00.579668 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 25.83µs to process 0 records I0418 11:15:00.579676 1 tasks_processing.go:71] worker 49 working on version task. I0418 11:15:00.579619 1 tasks_processing.go:71] worker 41 working on authentication task. I0418 11:15:00.579797 1 tasks_processing.go:71] worker 38 working on install_plans task. I0418 11:15:00.579859 1 tasks_processing.go:71] worker 20 working on pdbs task. I0418 11:15:00.579910 1 tasks_processing.go:71] worker 57 working on machine_configs task. I0418 11:15:00.579958 1 tasks_processing.go:71] worker 60 working on machine_sets task. I0418 11:15:00.580033 1 tasks_processing.go:71] worker 33 working on qemu_kubevirt_launcher_logs task. I0418 11:15:00.580042 1 tasks_processing.go:71] worker 28 working on active_alerts task. I0418 11:15:00.580052 1 tasks_processing.go:71] worker 40 working on container_images task. W0418 11:15:00.580065 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 11:15:00.580074 1 tasks_processing.go:71] worker 39 working on validating_webhook_configurations task. I0418 11:15:00.580079 1 tasks_processing.go:74] worker 28 stopped. I0418 11:15:00.580087 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 27.843µs to process 0 records I0418 11:15:00.580099 1 tasks_processing.go:71] worker 58 working on clusterroles task. I0418 11:15:00.580143 1 tasks_processing.go:71] worker 35 working on openstack_controlplanes task. I0418 11:15:00.580153 1 tasks_processing.go:71] worker 61 working on networks task. I0418 11:15:00.580165 1 tasks_processing.go:71] worker 30 working on openstack_dataplanenodesets task. I0418 11:15:00.580301 1 tasks_processing.go:71] worker 34 working on aggregated_monitoring_cr_names task. I0418 11:15:00.580324 1 tasks_processing.go:71] worker 46 working on dvo_metrics task. I0418 11:15:00.580334 1 tasks_processing.go:71] worker 43 working on machine_healthchecks task. I0418 11:15:00.580340 1 tasks_processing.go:71] worker 31 working on olm_operators task. I0418 11:15:00.585346 1 tasks_processing.go:74] worker 1 stopped. E0418 11:15:00.585362 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0418 11:15:00.585371 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 6.973321ms to process 0 records I0418 11:15:00.585382 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 7.223244ms to process 0 records I0418 11:15:00.585387 1 tasks_processing.go:74] worker 0 stopped. I0418 11:15:00.587370 1 tasks_processing.go:74] worker 11 stopped. I0418 11:15:00.587389 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 8.946036ms to process 0 records I0418 11:15:00.587398 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 9.232796ms to process 0 records I0418 11:15:00.587405 1 tasks_processing.go:74] worker 14 stopped. I0418 11:15:00.587490 1 tasks_processing.go:74] worker 2 stopped. I0418 11:15:00.587513 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 9.140354ms to process 0 records I0418 11:15:00.587529 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 8.898978ms to process 0 records I0418 11:15:00.587536 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 8.417864ms to process 0 records I0418 11:15:00.587540 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 8.490278ms to process 0 records I0418 11:15:00.587543 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 8.519565ms to process 0 records I0418 11:15:00.587547 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 8.903385ms to process 0 records I0418 11:15:00.587560 1 tasks_processing.go:74] worker 45 stopped. I0418 11:15:00.587566 1 tasks_processing.go:74] worker 23 stopped. I0418 11:15:00.587569 1 tasks_processing.go:74] worker 24 stopped. I0418 11:15:00.587572 1 tasks_processing.go:74] worker 52 stopped. I0418 11:15:00.587575 1 tasks_processing.go:74] worker 19 stopped. I0418 11:15:00.588328 1 tasks_processing.go:74] worker 62 stopped. I0418 11:15:00.588342 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 9.453518ms to process 0 records I0418 11:15:00.588350 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 9.19089ms to process 0 records I0418 11:15:00.588395 1 tasks_processing.go:74] worker 50 stopped. I0418 11:15:00.588456 1 tasks_processing.go:74] worker 15 stopped. I0418 11:15:00.588486 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=e39a5c9377630e5fd978c899e79a486a454e66ad512d5bff7b7c6c8071ac95c5 I0418 11:15:00.588507 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=796ca3b105890457b9271c2b02ee23154f7fff5613b24817e061232f223a254e I0418 11:15:00.588515 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 9.974636ms to process 2 records I0418 11:15:00.588713 1 tasks_processing.go:74] worker 32 stopped. I0418 11:15:00.588731 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 9.494013ms to process 0 records I0418 11:15:00.588741 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 9.709157ms to process 0 records I0418 11:15:00.588751 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 9.260283ms to process 0 records I0418 11:15:00.588761 1 tasks_processing.go:74] worker 44 stopped. I0418 11:15:00.588766 1 tasks_processing.go:74] worker 5 stopped. I0418 11:15:00.588846 1 tasks_processing.go:74] worker 53 stopped. E0418 11:15:00.588859 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0418 11:15:00.588866 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0418 11:15:00.588869 1 gather.go:177] gatherer "clusterconfig" function "machines" took 9.56181ms to process 0 records I0418 11:15:00.588881 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0418 11:15:00.588890 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0418 11:15:00.588893 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0418 11:15:00.588908 1 controller.go:489] The operator is still being initialized I0418 11:15:00.588917 1 controller.go:512] The operator is healthy I0418 11:15:00.588965 1 tasks_processing.go:74] worker 26 stopped. I0418 11:15:00.589088 1 recorder.go:75] Recording config/featuregate with fingerprint=2ee150b1efc52d5449b299bdc78f4c8790a72204ff3e3ce77fa3252149a62fec I0418 11:15:00.589099 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 10.569516ms to process 1 records I0418 11:15:00.593492 1 tasks_processing.go:74] worker 3 stopped. I0418 11:15:00.594018 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=858e2ffffeb95ec4ab5d3e3734e61d4114afc6a5ba614ca888ea55b6c0afc68a I0418 11:15:00.594039 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 14.644453ms to process 1 records I0418 11:15:00.598959 1 tasks_processing.go:74] worker 35 stopped. I0418 11:15:00.598975 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 18.802918ms to process 0 records I0418 11:15:00.598984 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 20.265621ms to process 0 records I0418 11:15:00.598989 1 tasks_processing.go:74] worker 59 stopped. I0418 11:15:00.599859 1 tasks_processing.go:74] worker 25 stopped. I0418 11:15:00.599873 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 20.818913ms to process 0 records I0418 11:15:00.599879 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 19.689632ms to process 0 records I0418 11:15:00.599886 1 tasks_processing.go:74] worker 30 stopped. E0418 11:15:00.599890 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0418 11:15:00.599897 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 21.373896ms to process 0 records I0418 11:15:00.599899 1 tasks_processing.go:74] worker 9 stopped. I0418 11:15:00.599904 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 19.911999ms to process 0 records I0418 11:15:00.599909 1 tasks_processing.go:74] worker 60 stopped. I0418 11:15:00.599932 1 tasks_processing.go:74] worker 43 stopped. E0418 11:15:00.599947 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0418 11:15:00.599959 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 19.581872ms to process 0 records I0418 11:15:00.600222 1 tasks_processing.go:74] worker 61 stopped. I0418 11:15:00.600506 1 recorder.go:75] Recording config/network with fingerprint=29d2ed8d35050ffe59c62801e66f4ee97069286086bd3a8f68ceae0667f0b75e I0418 11:15:00.600525 1 gather.go:177] gatherer "clusterconfig" function "networks" took 20.051538ms to process 1 records I0418 11:15:00.601870 1 tasks_processing.go:74] worker 16 stopped. I0418 11:15:00.602654 1 recorder.go:75] Recording config/image with fingerprint=2c56ecbe3441c620ff3b6442b26e864699c7363ea1b2f6684989347972596869 I0418 11:15:00.602764 1 gather.go:177] gatherer "clusterconfig" function "image" took 23.022695ms to process 1 records I0418 11:15:00.602792 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 23.071276ms to process 0 records I0418 11:15:00.602800 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 22.882251ms to process 0 records I0418 11:15:00.602818 1 tasks_processing.go:74] worker 54 stopped. I0418 11:15:00.602835 1 tasks_processing.go:74] worker 29 stopped. I0418 11:15:00.602909 1 tasks_processing.go:74] worker 27 stopped. I0418 11:15:00.604870 1 recorder.go:75] Recording config/infrastructure with fingerprint=fa895e3628e937b0e18a24cfa1dc0d2a97a2f0cd199f3f8fed786b898f78ba64 I0418 11:15:00.604889 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 22.891803ms to process 1 records I0418 11:15:00.604981 1 tasks_processing.go:74] worker 13 stopped. I0418 11:15:00.605115 1 recorder.go:75] Recording config/oauth with fingerprint=9308d157c52061f8b8ca0c20265c0c9c18e83954a5fad07649e5bea795188feb I0418 11:15:00.605128 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 23.319267ms to process 1 records I0418 11:15:00.605187 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=fa418899b836dc0807f6107d217c591b008c2a363b2cec54139f97677957f201 I0418 11:15:00.605201 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 23.153172ms to process 1 records I0418 11:15:00.605207 1 tasks_processing.go:74] worker 56 stopped. I0418 11:15:00.605250 1 tasks_processing.go:74] worker 41 stopped. I0418 11:15:00.605427 1 recorder.go:75] Recording config/authentication with fingerprint=46cf1e3b05259a5748ae628ff111c2bbc8712f9be102c9d39333ee682acd7bf3 I0418 11:15:00.605439 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 23.510698ms to process 1 records I0418 11:15:00.605503 1 recorder.go:75] Recording config/proxy with fingerprint=0b64e3fcba1d5f6d53d40d0c69c1a466f94df43d61805fa3e3bfe5341a98735d I0418 11:15:00.605512 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 23.984507ms to process 1 records I0418 11:15:00.605524 1 tasks_processing.go:74] worker 22 stopped. I0418 11:15:00.605581 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=0e70659fd7b40b1a7f6f1b40b48cc05a02a40098dae65e3267918e1f11528b5b I0418 11:15:00.605591 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 24.61164ms to process 1 records I0418 11:15:00.605592 1 tasks_processing.go:74] worker 51 stopped. I0418 11:15:00.605665 1 tasks_processing.go:74] worker 10 stopped. I0418 11:15:00.605691 1 recorder.go:75] Recording config/ingress with fingerprint=597ebc3a8ad77338bb2bba5353e5be3d33565a1c21a8657103bbefe0768d80f8 I0418 11:15:00.605699 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 24.472702ms to process 1 records I0418 11:15:00.605768 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=2fca45749dcfad7462509acde09a89ec6395a78edac1f202883b2d6ce97fc45f I0418 11:15:00.605779 1 tasks_processing.go:74] worker 20 stopped. I0418 11:15:00.605797 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=1538f59ca268814a0ecd41bdedbec383d833cc0795423f47f86daf657c2373c0 I0418 11:15:00.605831 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=4b783f4b7e8277a04ca1a624634a7a4e3311b7e475c018eefdb4fa789cba0d6b I0418 11:15:00.605843 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 24.299303ms to process 3 records I0418 11:15:00.605858 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0418 11:15:00.605864 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 26.761014ms to process 1 records I0418 11:15:00.605874 1 tasks_processing.go:74] worker 8 stopped. I0418 11:15:00.606157 1 tasks_processing.go:74] worker 12 stopped. I0418 11:15:00.606381 1 recorder.go:75] Recording config/apiserver with fingerprint=d487582ffb1c6e0983a00019f4d7f089de1cc93388ca4b2d0256bdf296adfd66 I0418 11:15:00.606403 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 26.891865ms to process 1 records I0418 11:15:00.606574 1 tasks_processing.go:74] worker 4 stopped. I0418 11:15:00.606730 1 recorder.go:75] Recording config/node/ip-10-0-0-175.ec2.internal with fingerprint=4a15498169cb3c26e8273b172a4779770901087ff0528a31d7482c529c6ab11f I0418 11:15:00.606800 1 recorder.go:75] Recording config/node/ip-10-0-1-188.ec2.internal with fingerprint=fdb8e499d73db97af64711dab520c5982033f59fe1fa568b4af41ec8a8216b4e I0418 11:15:00.606899 1 recorder.go:75] Recording config/node/ip-10-0-2-58.ec2.internal with fingerprint=0d50f44b86c0ce9d3e7483b1e675b7e9ebbd28a17b70823d975f6b837bcee589 I0418 11:15:00.606914 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 27.715039ms to process 3 records I0418 11:15:00.607692 1 tasks_processing.go:74] worker 36 stopped. I0418 11:15:00.607707 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 28.507561ms to process 0 records I0418 11:15:00.607925 1 tasks_processing.go:74] worker 17 stopped. I0418 11:15:00.607939 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 29.532016ms to process 0 records I0418 11:15:00.608151 1 tasks_processing.go:74] worker 63 stopped. I0418 11:15:00.608418 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=ca3192ab85c9ce23822e4b6d5a04d135252171482e55bd430e8fac3616cc3ab5 I0418 11:15:00.608465 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=f5016d8b7276155dbe2a9967bc27923ababec57917983da8f7e5533b7ce14d03 I0418 11:15:00.608505 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f138badda69b1b0b2c53962f9f2dd41a27d44a53c6d46acde4bc4c84c76e0ef2 I0418 11:15:00.608517 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 29.113097ms to process 3 records I0418 11:15:00.610600 1 gather_logs.go:145] no pods in namespace were found I0418 11:15:00.610620 1 tasks_processing.go:74] worker 33 stopped. I0418 11:15:00.610633 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 30.574667ms to process 0 records W0418 11:15:00.618928 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 11:15:00.625260 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0418 11:15:00.625277 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0418 11:15:00.625397 1 operator.go:288] started I0418 11:15:00.625423 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0418 11:15:00.625728 1 tasks_processing.go:74] worker 58 stopped. I0418 11:15:00.625996 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=0003fc89b56efd8c8317b849d80b293dab11a69b0619f53cf5dee54453872b73 I0418 11:15:00.626141 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=4308f9974683273c5036e916c9ee5218521098dd787a3c4f61496975d8946a87 I0418 11:15:00.626157 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 45.61371ms to process 2 records I0418 11:15:00.626254 1 tasks_processing.go:74] worker 48 stopped. I0418 11:15:00.626942 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=d7d1e9c55b749d54e065e44c61681a62efffff9c737204b159df8a483ae20590 I0418 11:15:00.627297 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=d032d55a6c11dc3085abf12713b22e16acd51d4e88c68ab74d01b0e2795cd16c I0418 11:15:00.627314 1 gather.go:177] gatherer "clusterconfig" function "crds" took 46.486201ms to process 2 records I0418 11:15:00.627895 1 tasks_processing.go:74] worker 39 stopped. I0418 11:15:00.628073 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=ea8b223f358fdcee31977cd342dfbae44750be53eaa5d0d79861f084ef2fa26a I0418 11:15:00.628326 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=19a209164a9f93f192b7a58d8920058fd45b6c375e7643587ea73edb669a7996 I0418 11:15:00.628387 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=6b593ae9ac802de859c16a7d5dc3528fe2e3337e68cc3071fab7f1a732f622d6 I0418 11:15:00.628431 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=963f57485aea7cd141c806ad4be3658fd4a8fd221413b52dd3f41c7c2d848e1a I0418 11:15:00.628488 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=adc31cca8f5a1eb1a47f292c454b0bc01630a36e07663c2c4601ca5341a8e651 I0418 11:15:00.628556 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=3fe883bf80e8a1fa12f7ad09783c5d7dfa9c34439b97399117a28bc29db5f0a6 I0418 11:15:00.628639 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=5fee8e235e14435df7054008a529ba2b4cd50edb44c6f425fb4b4ef8ee069bbe I0418 11:15:00.628700 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=3ba6440418680ce209be509cc911f0f973b9ea911aeac62b7920196403e6db35 I0418 11:15:00.628780 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=d7170b76d9a45925015159b5178388efd14b018ba500ba6e7231f0f4b0f2046a I0418 11:15:00.628822 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=d6e87f3e306986f21a1555b27356aa8cb36d64a08b7f6b3ec60dcb4b604c7342 I0418 11:15:00.628870 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=b83446f8a138d4e00d0392400e45a2f12a0165fd93fd8ab23d66f5535ef87ea4 I0418 11:15:00.628884 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 45.900262ms to process 11 records I0418 11:15:00.628894 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 46.057716ms to process 0 records I0418 11:15:00.628907 1 tasks_processing.go:74] worker 34 stopped. I0418 11:15:00.635649 1 tasks_processing.go:74] worker 31 stopped. I0418 11:15:00.635735 1 recorder.go:75] Recording config/olm_operators with fingerprint=0454f4e5da1f82432f048f4c2bbd50e75afe8599ba3fbcf1279d2c26bdb1a31f I0418 11:15:00.635757 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 55.291955ms to process 1 records I0418 11:15:00.639649 1 tasks_processing.go:74] worker 40 stopped. I0418 11:15:00.639730 1 recorder.go:75] Recording config/running_containers with fingerprint=fae05068898298582d8f15d46d71e95463514e43e50b973d5e2ad4f3db375dfd I0418 11:15:00.639743 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 59.577006ms to process 1 records I0418 11:15:00.640593 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0418 11:15:00.640622 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0418 11:15:00.640648 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0418 11:15:00.647988 1 base_controller.go:82] Caches are synced for ConfigController I0418 11:15:00.648012 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0418 11:15:00.659056 1 tasks_processing.go:74] worker 21 stopped. I0418 11:15:00.659080 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 79.452233ms to process 0 records I0418 11:15:00.662100 1 prometheus_rules.go:88] Prometheus rules successfully created I0418 11:15:00.662938 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0418 11:15:00.662954 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0418 11:15:00.662958 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0418 11:15:00.662964 1 controller.go:212] Source scaController *sca.Controller is not ready I0418 11:15:00.662968 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0418 11:15:00.662997 1 controller.go:489] The operator is still being initialized I0418 11:15:00.663010 1 controller.go:512] The operator is healthy I0418 11:15:00.667929 1 configmapobserver.go:84] configmaps "insights-config" not found E0418 11:15:00.670012 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27cdc1a7ae-a483-4edb-9066-d97a75814491%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:44561->172.30.0.10:53: read: connection refused I0418 11:15:00.670028 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27cdc1a7ae-a483-4edb-9066-d97a75814491%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:44561->172.30.0.10:53: read: connection refused I0418 11:15:00.688545 1 tasks_processing.go:74] worker 7 stopped. E0418 11:15:00.688565 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0418 11:15:00.688571 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0418 11:15:00.688574 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0418 11:15:00.688587 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0418 11:15:00.688616 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0418 11:15:00.688620 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0418 11:15:00.688625 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0418 11:15:00.688630 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0418 11:15:00.688668 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0418 11:15:00.688676 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0418 11:15:00.688682 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 109.090542ms to process 7 records I0418 11:15:00.700438 1 tasks_processing.go:74] worker 49 stopped. I0418 11:15:00.700873 1 recorder.go:75] Recording config/version with fingerprint=acc2f5c2892cc2bc306c74b29235bdab64d15fdf37ff134642624dc75cb080a1 I0418 11:15:00.700891 1 recorder.go:75] Recording config/id with fingerprint=086d34790267726e81e549e2b293ad7b45ee18762051ccd74e508c979c60e64a I0418 11:15:00.700902 1 gather.go:177] gatherer "clusterconfig" function "version" took 120.744791ms to process 2 records I0418 11:15:00.703037 1 tasks_processing.go:74] worker 57 stopped. I0418 11:15:00.703065 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0418 11:15:00.703075 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 123.106001ms to process 1 records I0418 11:15:00.714259 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0418 11:15:00.718323 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:46937->172.30.0.10:53: read: connection refused I0418 11:15:00.718339 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:46937->172.30.0.10:53: read: connection refused I0418 11:15:00.726512 1 base_controller.go:82] Caches are synced for LoggingSyncer I0418 11:15:00.726530 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0418 11:15:00.743394 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0418 11:15:00.759045 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0418 11:15:00.762960 1 tasks_processing.go:74] worker 18 stopped. E0418 11:15:00.762977 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0418 11:15:00.762986 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2poh97f4c9s2vlk6m4nartqi6f3bgr8e-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2poh97f4c9s2vlk6m4nartqi6f3bgr8e-primary-cert-bundle-secret" not found I0418 11:15:00.763066 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=fae52b09ae847a0f390db3b3dc720fc291eb1864a9f44855e1ffd20841b91231 I0418 11:15:00.763083 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 183.304063ms to process 1 records I0418 11:15:01.020977 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0418 11:15:01.020995 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0418 11:15:01.021560 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-rpstr pod in namespace openshift-dns (previous: false). I0418 11:15:01.248373 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-rpstr pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-rpstr\" is waiting to start: ContainerCreating" I0418 11:15:01.248394 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-rpstr\" is waiting to start: ContainerCreating" I0418 11:15:01.248403 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-rpstr pod in namespace openshift-dns (previous: false). I0418 11:15:01.430710 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-rpstr pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-rpstr\" is waiting to start: ContainerCreating" I0418 11:15:01.430728 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-rpstr\" is waiting to start: ContainerCreating" I0418 11:15:01.430743 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-sd6st pod in namespace openshift-dns (previous: false). W0418 11:15:01.618827 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 11:15:01.649368 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sd6st pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-sd6st\" is waiting to start: ContainerCreating" I0418 11:15:01.649391 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-sd6st\" is waiting to start: ContainerCreating" I0418 11:15:01.649401 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-sd6st pod in namespace openshift-dns (previous: false). I0418 11:15:01.828026 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sd6st pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-sd6st\" is waiting to start: ContainerCreating" I0418 11:15:01.828047 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-sd6st\" is waiting to start: ContainerCreating" I0418 11:15:01.828077 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-tkl5d pod in namespace openshift-dns (previous: false). I0418 11:15:02.052749 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-tkl5d pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-tkl5d\" is waiting to start: ContainerCreating" I0418 11:15:02.052766 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-tkl5d\" is waiting to start: ContainerCreating" I0418 11:15:02.052776 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-tkl5d pod in namespace openshift-dns (previous: false). I0418 11:15:02.061187 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0418 11:15:02.229656 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-tkl5d pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-tkl5d\" is waiting to start: ContainerCreating" I0418 11:15:02.229677 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-tkl5d\" is waiting to start: ContainerCreating" I0418 11:15:02.229687 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-dmrrh pod in namespace openshift-dns (previous: false). I0418 11:15:02.427495 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 11:15:02.427516 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-rhjzv pod in namespace openshift-dns (previous: false). I0418 11:15:02.463188 1 tasks_processing.go:74] worker 47 stopped. I0418 11:15:02.463264 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=1a0b19b338b7c44b6dfd8b45512ad4fa4e7686034f5fcd018022bf8aa69ab7b9 I0418 11:15:02.463300 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=83b41dd4b11cb05a08ebd17ecacfe685f26d4fc5dd43789589f8ca6ed89bbfd8 I0418 11:15:02.463331 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0418 11:15:02.463357 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=3a1c5b48953879242a2004578863d07356cf323102678d31cdfa90a1e7b1b950 I0418 11:15:02.463374 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0418 11:15:02.463411 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=9ade1e1b5ddcd9ce7f1fdcdfaa74b8c12d17ede9a8bf3bd15db0421f2601e9cb I0418 11:15:02.463441 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=d74b09aab1e015a1a28e22052cbea405dd3d8909e0ecb5bac063585b0b0878ec I0418 11:15:02.463466 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=66f899f5ca39ed8ca8eb060e6743a32e0a372a3b9ea7506bdd2adac48c93024b I0418 11:15:02.463480 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=f0dab89aacd380c55141c95a8ca608d579411dab4d6b9deaf9b9a397286aa42a I0418 11:15:02.463496 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=ab84df793362fcde30d8b5f4963ba12276ddaf83186963970263dd3b0aebdf31 I0418 11:15:02.463506 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0418 11:15:02.463522 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=8b928feace7a97664782b06940ceaba37110050df500026e48b802b452ec03da I0418 11:15:02.463533 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0418 11:15:02.463547 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=3fedb84c7fbff89523e047bc9e8e57ff7398bdce1904171436aae8ae70573804 I0418 11:15:02.463556 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0418 11:15:02.463569 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=63e5e61f4b78d48ec45514ac1f6924235cdb1c69a9f13a4f2d8c21f1556caf7c I0418 11:15:02.463578 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0418 11:15:02.463595 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=d16a23c1ea7db2ee48e4533f34b364346461a4f9d09fca38c5a256a092ee3984 I0418 11:15:02.463716 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=ace1e9651ba61fb234da3ec849114fbbd73d326f9fca0ea1087ab8d8c41584e2 I0418 11:15:02.463727 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0418 11:15:02.463734 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0418 11:15:02.463757 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0418 11:15:02.463779 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=aa1fb7807b23bf74981fffc6f602ec2ec92ed7ecd63e835d449fe3cb14d3b1a3 I0418 11:15:02.463801 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=fff616ecb34da2e74808c1360caa3426988352a7f4376118c592e6673e415acd I0418 11:15:02.463810 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0418 11:15:02.463836 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=e130d0806fc0713f3ba3ba6802f6bfbaffc4f2200a39b24ac75aa77a377ffa18 I0418 11:15:02.463847 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0418 11:15:02.463860 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=cfe5fc03117601e576142a566b9fd1e7f1046a3db0055e372600b6a051a21a8d I0418 11:15:02.463880 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=22f111728044890164004e985d685eb154ce22167577d68a70e073cb16b1953b I0418 11:15:02.463897 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=767a4c8d565d262937f3f7bc76e66c91bc3fe7b72f230e8b961fd5f9a5e9a565 I0418 11:15:02.463913 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=25903b05026ad5e7365c9d30b7538c2cfbd02f2d350a32ea46fa98b490875f33 I0418 11:15:02.463927 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=292c19a7f294fc536c203ae4f7e7cbb48108d675664a7f0cfce3bad7607e1078 I0418 11:15:02.463961 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=08fe313453d3bd794a97a196404d9e4b18a738603ccfb462358ec40334b94eb4 I0418 11:15:02.463977 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0418 11:15:02.463986 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0418 11:15:02.463993 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.884370561s to process 35 records W0418 11:15:02.618767 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 11:15:02.628605 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 11:15:02.628624 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vdglb pod in namespace openshift-dns (previous: false). I0418 11:15:02.839311 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 11:15:02.839374 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5496fcbb5f-gdv2x pod in namespace openshift-image-registry (previous: false). I0418 11:15:03.027950 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5496fcbb5f-gdv2x pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5496fcbb5f-gdv2x\" is waiting to start: ContainerCreating" I0418 11:15:03.027970 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5496fcbb5f-gdv2x\" is waiting to start: ContainerCreating" I0418 11:15:03.028017 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-689d54c484-n45wp pod in namespace openshift-image-registry (previous: false). I0418 11:15:03.228793 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-689d54c484-n45wp pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-689d54c484-n45wp\" is waiting to start: ContainerCreating" I0418 11:15:03.228812 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-689d54c484-n45wp\" is waiting to start: ContainerCreating" I0418 11:15:03.228851 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-689d54c484-pk2lb pod in namespace openshift-image-registry (previous: false). I0418 11:15:03.426012 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-689d54c484-pk2lb pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-689d54c484-pk2lb\" is waiting to start: ContainerCreating" I0418 11:15:03.426031 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-689d54c484-pk2lb\" is waiting to start: ContainerCreating" I0418 11:15:03.426043 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6nvdg pod in namespace openshift-image-registry (previous: false). W0418 11:15:03.618886 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 11:15:03.626112 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 11:15:03.626130 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-gfnlb pod in namespace openshift-image-registry (previous: false). I0418 11:15:03.827635 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 11:15:03.827662 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-wjk69 pod in namespace openshift-image-registry (previous: false). I0418 11:15:04.028634 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 11:15:04.028658 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-b4b69cc99-bfx9m pod in namespace openshift-ingress (previous: false). I0418 11:15:04.228141 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-b4b69cc99-bfx9m pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-b4b69cc99-bfx9m\" is waiting to start: ContainerCreating" I0418 11:15:04.228162 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-b4b69cc99-bfx9m\" is waiting to start: ContainerCreating" I0418 11:15:04.228174 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-b4b69cc99-bsxf7 pod in namespace openshift-ingress (previous: false). I0418 11:15:04.431807 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-b4b69cc99-bsxf7 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-b4b69cc99-bsxf7\" is waiting to start: ContainerCreating" I0418 11:15:04.431828 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-b4b69cc99-bsxf7\" is waiting to start: ContainerCreating" I0418 11:15:04.431840 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-b57b9765-ds2b6 pod in namespace openshift-ingress (previous: false). W0418 11:15:04.619000 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 11:15:04.628926 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-b57b9765-ds2b6 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-b57b9765-ds2b6\" is waiting to start: ContainerCreating" I0418 11:15:04.628942 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-b57b9765-ds2b6\" is waiting to start: ContainerCreating" I0418 11:15:04.628954 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-ht875 pod in namespace openshift-ingress-canary (previous: false). I0418 11:15:04.827442 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-ht875 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-ht875\" is waiting to start: ContainerCreating" I0418 11:15:04.827466 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-ht875\" is waiting to start: ContainerCreating" I0418 11:15:04.827495 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-s9k99 pod in namespace openshift-ingress-canary (previous: false). I0418 11:15:05.029362 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-s9k99 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-s9k99\" is waiting to start: ContainerCreating" I0418 11:15:05.029380 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-s9k99\" is waiting to start: ContainerCreating" I0418 11:15:05.029412 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-v6bk6 pod in namespace openshift-ingress-canary (previous: false). I0418 11:15:05.226639 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-v6bk6 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-v6bk6\" is waiting to start: ContainerCreating" I0418 11:15:05.226658 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-v6bk6\" is waiting to start: ContainerCreating" I0418 11:15:05.226677 1 tasks_processing.go:74] worker 37 stopped. I0418 11:15:05.226766 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=4f0200e324f8bccb8470928f246cbf522eaa0ac319e3af8ce0cc2caca0d36c06 I0418 11:15:05.226816 1 recorder.go:75] Recording events/openshift-dns with fingerprint=7eb102c118fcef6e5fb30b1b89c58d684da552c8667dc44f4a958d191b0ee70c I0418 11:15:05.226900 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=d1b096f195baf4089230d2459e92b4c56f7a22feca305275651ec4073ab523aa I0418 11:15:05.226937 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=b56eb3903de7a89604a58e92031b39aec2a2c5a5bc15a6b7a1414e0691264b19 I0418 11:15:05.226982 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=deb85e1f63fa886d6107e12b4b68ab8260218ab10a7f8a496304ba39ff5aa8a2 I0418 11:15:05.226999 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=a8711c2b4fb6e241d00a955203d3454dbfc307a2b81370b04a8c1c68d89ae3a6 I0418 11:15:05.228346 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-rpstr with fingerprint=6d409f36cc9eb5d837b9fb7bf64b87cd7d64a7eb915e4c620456fdb114c1893a I0418 11:15:05.228442 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-tkl5d with fingerprint=f48e182f3f26c88bf26411182a9ae24c155e8c1d0e4aecc89492323c12092c30 I0418 11:15:05.228543 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5496fcbb5f-gdv2x with fingerprint=d306885c1184413467969fa3d58c57928aed3a57ef3cebc02d8e458b73387f45 I0418 11:15:05.228641 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-689d54c484-n45wp with fingerprint=821722bb3e043a1c5fa80418568315242ac28993941aafc855535274b037a437 I0418 11:15:05.228730 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-689d54c484-pk2lb with fingerprint=a4623d053bb83965c65a33a1191c1827247855c126177b008fab41d788cb4d84 I0418 11:15:05.228788 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-s9k99 with fingerprint=908a8692976987fe6f5711a6e76ac559b8f03794a5b3b58dc3d61255b1ebd2e1 I0418 11:15:05.228843 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-v6bk6 with fingerprint=b2640bcab2cd13d94b1e66805ea49667f08dea7ba354f2ec9e78b53722df25d9 I0418 11:15:05.228853 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.64790087s to process 13 records W0418 11:15:05.618666 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0418 11:15:05.618693 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0418 11:15:05.618708 1 tasks_processing.go:74] worker 46 stopped. E0418 11:15:05.618716 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0418 11:15:05.618728 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0418 11:15:05.618742 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0418 11:15:05.618753 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.038371221s to process 1 records I0418 11:15:13.018159 1 tasks_processing.go:74] worker 38 stopped. I0418 11:15:13.018204 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0418 11:15:13.018217 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.438334454s to process 1 records I0418 11:15:13.779381 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 11:15:13.786690 1 tasks_processing.go:74] worker 55 stopped. I0418 11:15:13.786966 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=751aa8b7d1208af5fd734152a53c8f2354708612b0cd50cfd9c595651a5cc8c8 I0418 11:15:13.786983 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.207090526s to process 1 records E0418 11:15:13.787040 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.209s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0418 11:15:13.788161 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0418 11:15:13.788175 1 periodic.go:209] Running workloads gatherer I0418 11:15:13.788191 1 tasks_processing.go:45] number of workers: 2 I0418 11:15:13.788197 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 11:15:13.788201 1 tasks_processing.go:71] worker 1 working on workload_info task. I0418 11:15:13.788210 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 11:15:13.788241 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0418 11:15:13.826213 1 tasks_processing.go:74] worker 0 stopped. I0418 11:15:13.826260 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 37.95426ms to process 0 records I0418 11:15:13.913604 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0418 11:15:13.922816 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (10ms) I0418 11:15:13.932726 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (10ms) I0418 11:15:13.943281 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (11ms) I0418 11:15:13.954001 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (11ms) I0418 11:15:13.964172 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (10ms) I0418 11:15:13.974019 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (10ms) I0418 11:15:13.985145 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (11ms) I0418 11:15:13.993825 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (9ms) I0418 11:15:14.002282 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (8ms) I0418 11:15:14.010624 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (8ms) I0418 11:15:14.021939 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (11ms) I0418 11:15:14.122836 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (101ms) I0418 11:15:14.222395 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0418 11:15:14.322708 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0418 11:15:14.423745 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (101ms) I0418 11:15:14.522575 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (99ms) I0418 11:15:14.624736 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (102ms) I0418 11:15:14.723967 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (99ms) I0418 11:15:14.822957 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (99ms) I0418 11:15:14.922729 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0418 11:15:15.022807 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0418 11:15:15.122650 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0418 11:15:15.223333 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms) I0418 11:15:15.324525 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (101ms) I0418 11:15:15.423516 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (99ms) I0418 11:15:15.523646 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (100ms) I0418 11:15:15.624102 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0418 11:15:15.723459 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (99ms) I0418 11:15:15.823639 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0418 11:15:15.923542 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (100ms) I0418 11:15:16.023662 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0418 11:15:16.122545 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (99ms) I0418 11:15:16.122578 1 tasks_processing.go:74] worker 1 stopped. E0418 11:15:16.122592 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0418 11:15:16.122928 1 recorder.go:75] Recording config/workload_info with fingerprint=80e4ae6114088963732fc1122c7afb0d839dcd2de5fe134489a3f1e9d5321004 I0418 11:15:16.122945 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.334369063s to process 1 records E0418 11:15:16.122990 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.334s with: function \"workload_info\" failed with an error" I0418 11:15:16.124098 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0418 11:15:16.124112 1 periodic.go:209] Running conditional gatherer I0418 11:15:16.130956 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0418 11:15:16.137826 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.12:38852->172.30.0.10:53: read: connection refused E0418 11:15:16.138091 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 11:15:16.138156 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0418 11:15:16.145757 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0418 11:15:16.145779 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 11:15:16.145785 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 11:15:16.145788 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 11:15:16.145792 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 11:15:16.145795 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 11:15:16.145798 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 11:15:16.145802 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 11:15:16.145805 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 11:15:16.145808 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0418 11:15:16.145827 1 tasks_processing.go:45] number of workers: 3 I0418 11:15:16.145837 1 tasks_processing.go:69] worker 2 listening for tasks. I0418 11:15:16.145842 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0418 11:15:16.145851 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 11:15:16.145864 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0418 11:15:16.145866 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 11:15:16.145873 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0418 11:15:16.145877 1 tasks_processing.go:74] worker 1 stopped. I0418 11:15:16.145935 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0418 11:15:16.145948 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.189µs to process 1 records I0418 11:15:16.145979 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0418 11:15:16.145988 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.47µs to process 1 records I0418 11:15:16.145993 1 tasks_processing.go:74] worker 0 stopped. I0418 11:15:16.146141 1 tasks_processing.go:74] worker 2 stopped. I0418 11:15:16.146152 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 260.836µs to process 0 records I0418 11:15:16.146172 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.12:38852->172.30.0.10:53: read: connection refused I0418 11:15:16.146190 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0418 11:15:16.169454 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=2044ba10f0354dd066a3da612e61cb94255734a4c729e2a291ea483306a4cf2f I0418 11:15:16.169675 1 diskrecorder.go:70] Writing 107 records to /var/lib/insights-operator/insights-2026-04-18-111516.tar.gz I0418 11:15:16.176689 1 diskrecorder.go:51] Wrote 107 records to disk in 7ms I0418 11:15:16.176739 1 periodic.go:278] Gathering cluster info every 2h0m0s I0418 11:15:16.176756 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0418 11:15:16.888772 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 11:15:17.089271 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 11:15:30.436609 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 11:16:25.224194 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="627271d088c06c64d04de7b9210a3921d8014e9cbf4d2b36b2b4aa76c947014d") W0418 11:16:25.224239 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0418 11:16:25.224286 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="0f55d85e55b1f4fc113e12e36e9941e2afee9a6ce28ec319067502ae7081cca4") I0418 11:16:25.224307 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0418 11:16:25.224342 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0418 11:16:25.224354 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0418 11:16:25.224392 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="6d67c58007119c41a200d2fe9c2da8d5be524444d71921cac5b936374c06930e") I0418 11:16:25.224393 1 periodic.go:170] Shutting down I0418 11:16:25.224415 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0418 11:16:25.224427 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0418 11:16:25.224438 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0418 11:16:25.224433 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0418 11:16:25.224445 1 base_controller.go:181] Shutting down ConfigController ... I0418 11:16:25.224437 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I0418 11:16:25.224410 1 base_controller.go:181] Shutting down LoggingSyncer ... I0418 11:16:25.224485 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-1291828849/tls.crt::/tmp/serving-cert-1291828849/tls.key" I0418 11:16:25.224486 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0418 11:16:25.224509 1 secure_serving.go:258] Stopped listening on [::]:8443