W0326 23:35:40.030021 1 cmd.go:257] Using insecure, self-signed certificates I0326 23:35:40.699970 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0326 23:35:40.700314 1 observer_polling.go:159] Starting file observer I0326 23:35:41.380782 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0326 23:35:41.380969 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0326 23:35:41.381587 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0326 23:35:41.381608 1 secure_serving.go:57] Forcing use of http/1.1 only W0326 23:35:41.381625 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0326 23:35:41.381629 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0326 23:35:41.381633 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0326 23:35:41.381635 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0326 23:35:41.381638 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0326 23:35:41.381640 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0326 23:35:41.384814 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0326 23:35:41.384831 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"8a2fb1ac-41fc-4829-9861-fd548cd6a0df", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0326 23:35:41.386194 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0326 23:35:41.386207 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0326 23:35:41.386215 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0326 23:35:41.386221 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0326 23:35:41.386224 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0326 23:35:41.386635 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0326 23:35:41.386931 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3816708861/tls.crt::/tmp/serving-cert-3816708861/tls.key" I0326 23:35:41.387527 1 secure_serving.go:213] Serving securely on [::]:8443 I0326 23:35:41.387609 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0326 23:35:41.390260 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0326 23:35:41.390291 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0326 23:35:41.390385 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0326 23:35:41.394337 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:35:41.394368 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0326 23:35:41.398090 1 secretconfigobserver.go:119] support secret does not exist I0326 23:35:41.401533 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:35:41.404571 1 secretconfigobserver.go:119] support secret does not exist I0326 23:35:41.407279 1 recorder.go:161] Pruning old reports every 5h7m12s, max age is 288h0m0s I0326 23:35:41.411025 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0326 23:35:41.411035 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0326 23:35:41.411042 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0326 23:35:41.411050 1 insightsreport.go:296] Starting report retriever I0326 23:35:41.411059 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0326 23:35:41.411066 1 periodic.go:209] Running clusterconfig gatherer I0326 23:35:41.411123 1 tasks_processing.go:45] number of workers: 64 I0326 23:35:41.411153 1 tasks_processing.go:69] worker 4 listening for tasks. I0326 23:35:41.411161 1 tasks_processing.go:69] worker 16 listening for tasks. I0326 23:35:41.411167 1 tasks_processing.go:69] worker 5 listening for tasks. I0326 23:35:41.411170 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:35:41.411172 1 tasks_processing.go:71] worker 16 working on mutating_webhook_configurations task. I0326 23:35:41.411173 1 tasks_processing.go:69] worker 2 listening for tasks. I0326 23:35:41.411177 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:35:41.411179 1 tasks_processing.go:71] worker 2 working on node_logs task. I0326 23:35:41.411177 1 tasks_processing.go:71] worker 1 working on image_pruners task. I0326 23:35:41.411184 1 tasks_processing.go:69] worker 6 listening for tasks. I0326 23:35:41.411190 1 tasks_processing.go:69] worker 7 listening for tasks. I0326 23:35:41.411189 1 tasks_processing.go:69] worker 3 listening for tasks. I0326 23:35:41.411195 1 tasks_processing.go:69] worker 8 listening for tasks. I0326 23:35:41.411173 1 tasks_processing.go:71] worker 5 working on operators_pods_and_events task. I0326 23:35:41.411200 1 tasks_processing.go:69] worker 9 listening for tasks. I0326 23:35:41.411206 1 tasks_processing.go:69] worker 10 listening for tasks. I0326 23:35:41.411212 1 tasks_processing.go:69] worker 11 listening for tasks. I0326 23:35:41.411217 1 tasks_processing.go:69] worker 12 listening for tasks. I0326 23:35:41.411215 1 tasks_processing.go:69] worker 40 listening for tasks. I0326 23:35:41.411222 1 tasks_processing.go:69] worker 13 listening for tasks. I0326 23:35:41.411228 1 tasks_processing.go:69] worker 14 listening for tasks. I0326 23:35:41.411227 1 tasks_processing.go:69] worker 28 listening for tasks. I0326 23:35:41.411233 1 tasks_processing.go:69] worker 15 listening for tasks. I0326 23:35:41.411232 1 tasks_processing.go:69] worker 41 listening for tasks. I0326 23:35:41.411231 1 tasks_processing.go:69] worker 29 listening for tasks. I0326 23:35:41.411241 1 tasks_processing.go:69] worker 30 listening for tasks. I0326 23:35:41.411243 1 tasks_processing.go:69] worker 23 listening for tasks. I0326 23:35:41.411249 1 tasks_processing.go:69] worker 24 listening for tasks. I0326 23:35:41.411251 1 tasks_processing.go:69] worker 43 listening for tasks. I0326 23:35:41.411252 1 tasks_processing.go:69] worker 31 listening for tasks. I0326 23:35:41.411258 1 tasks_processing.go:69] worker 32 listening for tasks. I0326 23:35:41.411256 1 tasks_processing.go:69] worker 22 listening for tasks. I0326 23:35:41.411263 1 tasks_processing.go:69] worker 26 listening for tasks. I0326 23:35:41.411265 1 tasks_processing.go:69] worker 33 listening for tasks. I0326 23:35:41.411266 1 tasks_processing.go:69] worker 44 listening for tasks. I0326 23:35:41.411265 1 tasks_processing.go:69] worker 39 listening for tasks. I0326 23:35:41.411271 1 tasks_processing.go:69] worker 27 listening for tasks. I0326 23:35:41.411271 1 tasks_processing.go:69] worker 34 listening for tasks. I0326 23:35:41.411274 1 tasks_processing.go:69] worker 17 listening for tasks. I0326 23:35:41.411278 1 tasks_processing.go:69] worker 55 listening for tasks. I0326 23:35:41.411242 1 tasks_processing.go:69] worker 42 listening for tasks. I0326 23:35:41.411281 1 tasks_processing.go:69] worker 38 listening for tasks. I0326 23:35:41.411290 1 tasks_processing.go:69] worker 37 listening for tasks. I0326 23:35:41.411292 1 tasks_processing.go:69] worker 51 listening for tasks. I0326 23:35:41.411291 1 tasks_processing.go:69] worker 57 listening for tasks. I0326 23:35:41.411257 1 tasks_processing.go:69] worker 36 listening for tasks. I0326 23:35:41.411299 1 tasks_processing.go:69] worker 53 listening for tasks. I0326 23:35:41.411257 1 tasks_processing.go:69] worker 25 listening for tasks. I0326 23:35:41.411302 1 tasks_processing.go:69] worker 20 listening for tasks. I0326 23:35:41.411301 1 tasks_processing.go:69] worker 58 listening for tasks. I0326 23:35:41.411305 1 tasks_processing.go:69] worker 52 listening for tasks. I0326 23:35:41.411299 1 tasks_processing.go:69] worker 50 listening for tasks. I0326 23:35:41.411312 1 tasks_processing.go:71] worker 9 working on networks task. I0326 23:35:41.411315 1 tasks_processing.go:71] worker 23 working on olm_operators task. I0326 23:35:41.411317 1 tasks_processing.go:69] worker 54 listening for tasks. I0326 23:35:41.411322 1 tasks_processing.go:69] worker 48 listening for tasks. I0326 23:35:41.411324 1 tasks_processing.go:69] worker 62 listening for tasks. I0326 23:35:41.411328 1 tasks_processing.go:71] worker 54 working on version task. I0326 23:35:41.411329 1 tasks_processing.go:71] worker 53 working on schedulers task. I0326 23:35:41.411331 1 tasks_processing.go:71] worker 57 working on openstack_dataplanedeployments task. I0326 23:35:41.411332 1 tasks_processing.go:69] worker 49 listening for tasks. I0326 23:35:41.411337 1 tasks_processing.go:69] worker 59 listening for tasks. I0326 23:35:41.411347 1 tasks_processing.go:69] worker 63 listening for tasks. I0326 23:35:41.411283 1 tasks_processing.go:69] worker 56 listening for tasks. I0326 23:35:41.411352 1 tasks_processing.go:71] worker 4 working on machine_configs task. I0326 23:35:41.411353 1 tasks_processing.go:71] worker 20 working on container_images task. I0326 23:35:41.411358 1 tasks_processing.go:71] worker 39 working on machine_config_pools task. I0326 23:35:41.411359 1 tasks_processing.go:71] worker 40 working on ceph_cluster task. I0326 23:35:41.411357 1 tasks_processing.go:71] worker 31 working on openstack_controlplanes task. I0326 23:35:41.411374 1 tasks_processing.go:71] worker 12 working on machine_healthchecks task. I0326 23:35:41.411389 1 tasks_processing.go:71] worker 33 working on validating_webhook_configurations task. I0326 23:35:41.411317 1 tasks_processing.go:71] worker 50 working on cluster_apiserver task. I0326 23:35:41.411403 1 tasks_processing.go:71] worker 28 working on service_accounts task. I0326 23:35:41.411423 1 tasks_processing.go:71] worker 24 working on sap_datahubs task. I0326 23:35:41.411316 1 tasks_processing.go:71] worker 52 working on nodenetworkconfigurationpolicies task. I0326 23:35:41.411313 1 tasks_processing.go:69] worker 61 listening for tasks. I0326 23:35:41.411287 1 tasks_processing.go:71] worker 55 working on oauths task. I0326 23:35:41.411723 1 tasks_processing.go:71] worker 61 working on ingress_certificates task. I0326 23:35:41.411427 1 tasks_processing.go:71] worker 13 working on crds task. I0326 23:35:41.411284 1 tasks_processing.go:69] worker 18 listening for tasks. I0326 23:35:41.411247 1 tasks_processing.go:69] worker 35 listening for tasks. I0326 23:35:41.412215 1 tasks_processing.go:71] worker 18 working on install_plans task. I0326 23:35:41.411744 1 tasks_processing.go:71] worker 27 working on silenced_alerts task. I0326 23:35:41.411293 1 tasks_processing.go:71] worker 0 working on cost_management_metrics_configs task. I0326 23:35:41.412310 1 tasks_processing.go:71] worker 35 working on nodes task. I0326 23:35:41.411297 1 tasks_processing.go:71] worker 6 working on feature_gates task. I0326 23:35:41.411299 1 tasks_processing.go:71] worker 38 working on ingress task. I0326 23:35:41.411301 1 tasks_processing.go:71] worker 7 working on monitoring_persistent_volumes task. W0326 23:35:41.412701 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0326 23:35:41.412754 1 tasks_processing.go:71] worker 27 working on tsdb_status task. W0326 23:35:41.412805 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0326 23:35:41.412769 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 525.381µs to process 0 records I0326 23:35:41.411275 1 tasks_processing.go:69] worker 45 listening for tasks. I0326 23:35:41.412830 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 35.641µs to process 0 records I0326 23:35:41.412833 1 tasks_processing.go:71] worker 45 working on dvo_metrics task. I0326 23:35:41.411308 1 tasks_processing.go:71] worker 8 working on pod_network_connectivity_checks task. I0326 23:35:41.411310 1 tasks_processing.go:71] worker 58 working on proxies task. I0326 23:35:41.411309 1 tasks_processing.go:69] worker 46 listening for tasks. I0326 23:35:41.411309 1 tasks_processing.go:71] worker 25 working on openshift_logging task. I0326 23:35:41.413148 1 tasks_processing.go:71] worker 27 working on openstack_dataplanenodesets task. I0326 23:35:41.413170 1 tasks_processing.go:71] worker 46 working on openstack_version task. I0326 23:35:41.411317 1 tasks_processing.go:69] worker 47 listening for tasks. I0326 23:35:41.413204 1 tasks_processing.go:71] worker 47 working on aggregated_monitoring_cr_names task. I0326 23:35:41.411319 1 tasks_processing.go:71] worker 37 working on openshift_machine_api_events task. I0326 23:35:41.411318 1 tasks_processing.go:69] worker 60 listening for tasks. I0326 23:35:41.411324 1 tasks_processing.go:71] worker 51 working on config_maps task. I0326 23:35:41.413434 1 tasks_processing.go:71] worker 60 working on nodenetworkstates task. I0326 23:35:41.411326 1 tasks_processing.go:71] worker 36 working on sap_pods task. I0326 23:35:41.411326 1 tasks_processing.go:69] worker 21 listening for tasks. I0326 23:35:41.411338 1 tasks_processing.go:71] worker 26 working on storage_cluster task. I0326 23:35:41.411343 1 tasks_processing.go:71] worker 32 working on overlapping_namespace_uids task. I0326 23:35:41.411349 1 tasks_processing.go:71] worker 22 working on infrastructures task. I0326 23:35:41.411356 1 tasks_processing.go:71] worker 14 working on pdbs task. I0326 23:35:41.411431 1 tasks_processing.go:71] worker 34 working on metrics task. I0326 23:35:41.411431 1 tasks_processing.go:71] worker 44 working on active_alerts task. I0326 23:35:41.411287 1 tasks_processing.go:71] worker 42 working on certificate_signing_requests task. I0326 23:35:41.411769 1 tasks_processing.go:71] worker 43 working on machines task. I0326 23:35:41.411780 1 tasks_processing.go:71] worker 48 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0326 23:35:41.411780 1 tasks_processing.go:71] worker 49 working on storage_classes task. I0326 23:35:41.411790 1 tasks_processing.go:71] worker 62 working on jaegers task. I0326 23:35:41.411798 1 tasks_processing.go:71] worker 11 working on support_secret task. I0326 23:35:41.411798 1 tasks_processing.go:71] worker 41 working on image task. I0326 23:35:41.411827 1 tasks_processing.go:71] worker 63 working on lokistack task. I0326 23:35:41.411879 1 tasks_processing.go:71] worker 15 working on machine_sets task. I0326 23:35:41.411975 1 tasks_processing.go:71] worker 59 working on clusterroles task. I0326 23:35:41.411993 1 tasks_processing.go:71] worker 29 working on container_runtime_configs task. I0326 23:35:41.411293 1 tasks_processing.go:69] worker 19 listening for tasks. I0326 23:35:41.412026 1 tasks_processing.go:71] worker 10 working on qemu_kubevirt_launcher_logs task. I0326 23:35:41.412030 1 tasks_processing.go:71] worker 30 working on sap_config task. I0326 23:35:41.412052 1 tasks_processing.go:71] worker 17 working on authentication task. I0326 23:35:41.412124 1 tasks_processing.go:71] worker 56 working on image_registries task. I0326 23:35:41.411305 1 tasks_processing.go:71] worker 3 working on machine_autoscalers task. W0326 23:35:41.414460 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0326 23:35:41.414478 1 tasks_processing.go:74] worker 44 stopped. I0326 23:35:41.414488 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 903.67µs to process 0 records I0326 23:35:41.414496 1 tasks_processing.go:71] worker 21 working on operators task. I0326 23:35:41.414530 1 tasks_processing.go:74] worker 19 stopped. W0326 23:35:41.414624 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0326 23:35:41.414637 1 tasks_processing.go:74] worker 34 stopped. I0326 23:35:41.414647 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.067136ms to process 0 records I0326 23:35:41.415249 1 tasks_processing.go:74] worker 57 stopped. I0326 23:35:41.415261 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 3.897286ms to process 0 records I0326 23:35:41.415326 1 tasks_processing.go:74] worker 40 stopped. I0326 23:35:41.415344 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 3.952554ms to process 0 records I0326 23:35:41.416250 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0326 23:35:41.416272 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:35:41.416279 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:35:41.416284 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:35:41.416304 1 controller.go:489] The operator is still being initialized I0326 23:35:41.416317 1 controller.go:512] The operator is healthy I0326 23:35:41.416883 1 tasks_processing.go:74] worker 24 stopped. I0326 23:35:41.416899 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 5.424528ms to process 0 records I0326 23:35:41.416924 1 tasks_processing.go:74] worker 12 stopped. E0326 23:35:41.416937 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0326 23:35:41.416945 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 5.52925ms to process 0 records I0326 23:35:41.417098 1 tasks_processing.go:74] worker 1 stopped. I0326 23:35:41.417348 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=e8d3b7954b1e5e82371b6dec198badcd090b48812a7fafe55966f3b1670068f5 I0326 23:35:41.417361 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 5.905065ms to process 1 records I0326 23:35:41.417553 1 tasks_processing.go:74] worker 52 stopped. I0326 23:35:41.417562 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 5.926221ms to process 0 records I0326 23:35:41.417824 1 tasks_processing.go:74] worker 55 stopped. I0326 23:35:41.418011 1 recorder.go:75] Recording config/oauth with fingerprint=195345447a1c9ac8ad6d30449afcf4062b844d38c39648e20d460c34c95914af I0326 23:35:41.418026 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 6.177531ms to process 1 records I0326 23:35:41.418998 1 tasks_processing.go:74] worker 2 stopped. I0326 23:35:41.419012 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 7.813578ms to process 0 records I0326 23:35:41.420346 1 tasks_processing.go:74] worker 9 stopped. I0326 23:35:41.420481 1 recorder.go:75] Recording config/network with fingerprint=9910f906465b832024287f2b9fe70cec8224c00ee2dbd8521f43b484e22928f1 I0326 23:35:41.420496 1 gather.go:177] gatherer "clusterconfig" function "networks" took 9.020448ms to process 1 records I0326 23:35:41.423843 1 tasks_processing.go:74] worker 25 stopped. I0326 23:35:41.423858 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 10.765796ms to process 0 records I0326 23:35:41.423986 1 tasks_processing.go:74] worker 53 stopped. I0326 23:35:41.424048 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=db66327a82a7388675046fbe9117d8891112ed51309077f7a362f5b77a8f85a7 I0326 23:35:41.424060 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 12.637856ms to process 1 records I0326 23:35:41.424117 1 tasks_processing.go:74] worker 6 stopped. I0326 23:35:41.424166 1 recorder.go:75] Recording config/featuregate with fingerprint=fc7ecbfb64cf70ce1b09438501c356357952f754f2b543811a1f80ee67024f7e I0326 23:35:41.424176 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 11.612056ms to process 1 records I0326 23:35:41.435850 1 tasks_processing.go:74] worker 31 stopped. I0326 23:35:41.435864 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 24.474658ms to process 0 records I0326 23:35:41.435877 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 23.538307ms to process 0 records I0326 23:35:41.435882 1 tasks_processing.go:74] worker 0 stopped. I0326 23:35:41.436143 1 tasks_processing.go:74] worker 8 stopped. E0326 23:35:41.436158 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0326 23:35:41.436166 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 23.294973ms to process 0 records I0326 23:35:41.436220 1 tasks_processing.go:74] worker 46 stopped. I0326 23:35:41.436237 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 23.039177ms to process 0 records I0326 23:35:41.436267 1 tasks_processing.go:74] worker 50 stopped. I0326 23:35:41.436450 1 recorder.go:75] Recording config/apiserver with fingerprint=3764a32775d58376817c76aba84b7b5592b752bb2c8f53256019556536aa0cc6 I0326 23:35:41.436469 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 24.85745ms to process 1 records I0326 23:35:41.437061 1 tasks_processing.go:74] worker 58 stopped. I0326 23:35:41.437382 1 recorder.go:75] Recording config/proxy with fingerprint=a3c627248801895c20705a2be3f3b969fb7f898c3af0f9faa94ff9796228878e I0326 23:35:41.437448 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 24.19149ms to process 1 records I0326 23:35:41.437734 1 tasks_processing.go:74] worker 38 stopped. I0326 23:35:41.438018 1 recorder.go:75] Recording config/ingress with fingerprint=fc4fdf81ca72b1978a46379ef7b5bff972d6227e5b971fe98fdeda316cc092f4 I0326 23:35:41.438066 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 25.145543ms to process 1 records I0326 23:35:41.439928 1 tasks_processing.go:74] worker 16 stopped. I0326 23:35:41.440141 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=99379ac57244ee57c5d38911c04faa9ed9885b30956f5468af66e949e1da2afd I0326 23:35:41.440190 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=061b25603022fe395a94c4bf27f8cda48c3ad50747cd862c517b78f5e1c4e9c1 I0326 23:35:41.440217 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=a2a2b123d236ac22c8bf7ab18f58994ecadb2c0c5de7f751d0d1ace7612c5bf2 I0326 23:35:41.440226 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 28.746736ms to process 3 records I0326 23:35:41.440233 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 25.440752ms to process 0 records I0326 23:35:41.440237 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 27.275388ms to process 0 records I0326 23:35:41.440241 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 26.526811ms to process 0 records E0326 23:35:41.440246 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0326 23:35:41.440251 1 gather.go:177] gatherer "clusterconfig" function "machines" took 25.995486ms to process 0 records I0326 23:35:41.440256 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 26.090844ms to process 0 records I0326 23:35:41.440259 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 27.094637ms to process 0 records I0326 23:35:41.440263 1 tasks_processing.go:74] worker 7 stopped. I0326 23:35:41.440268 1 tasks_processing.go:74] worker 60 stopped. I0326 23:35:41.440265 1 tasks_processing.go:74] worker 27 stopped. I0326 23:35:41.440274 1 tasks_processing.go:74] worker 43 stopped. I0326 23:35:41.440276 1 tasks_processing.go:74] worker 62 stopped. I0326 23:35:41.440284 1 tasks_processing.go:74] worker 29 stopped. I0326 23:35:41.440338 1 tasks_processing.go:74] worker 39 stopped. I0326 23:35:41.440353 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 28.967113ms to process 0 records I0326 23:35:41.440686 1 tasks_processing.go:74] worker 3 stopped. I0326 23:35:41.440698 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 26.233815ms to process 0 records I0326 23:35:41.440734 1 tasks_processing.go:74] worker 33 stopped. I0326 23:35:41.440866 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=f12041f3585b17743fd336a7a1e894d58391220134426c14b1c15c5f2e1f8a9b I0326 23:35:41.440953 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=45f7042b0d0694926a19a246d819d1167fd7c13989700782a9d78c12ffcfe585 I0326 23:35:41.440974 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=e84482aad2df07df34f97dfb1fdd7d24aa4a5ea5b24d3ff57e93214d5f45804f I0326 23:35:41.441004 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=682dc362077f0be2b8464631b348bce2677eb308cdadf700b87a73f80677eeb2 I0326 23:35:41.441033 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=9a4da91098f677593457e178b430fb0e89557c37a3271fc21dc6aa89e7458c7d I0326 23:35:41.441060 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ae71b4da06033f9b1e9c2db28db55a265c76f68e0be4417dbcd87b240c84d954 I0326 23:35:41.441086 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=c7ffa976ede429c1f2b813ae1882446fa629e13e7a935796b2c86664175e7756 I0326 23:35:41.441140 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=6ecc1e1ab86bca738589a6df492f1ccb2dfcf9191a29c284525e987fa53ac1a6 I0326 23:35:41.441165 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=f2e8ae6d95516518a23d5658aa6e95513749659123e6b300aec4d65a8e9059ff I0326 23:35:41.441188 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=d4e66a81e5439faf8b24de5acda15adc20b4f293409543a9b389ed17a2e2800a I0326 23:35:41.441219 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=8155dd15bbde0df886273506f258e485dafd6060c15bf42a85ca84b5058ee8b0 I0326 23:35:41.441227 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 29.32948ms to process 11 records I0326 23:35:41.441237 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 26.279905ms to process 0 records I0326 23:35:41.441241 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 26.318631ms to process 0 records I0326 23:35:41.441251 1 tasks_processing.go:74] worker 15 stopped. I0326 23:35:41.441258 1 tasks_processing.go:74] worker 63 stopped. I0326 23:35:41.441320 1 tasks_processing.go:74] worker 35 stopped. I0326 23:35:41.441541 1 recorder.go:75] Recording config/node/ip-10-0-0-210.ec2.internal with fingerprint=ed8f024b24a2eb1898b5af76bbeb1b84213b201810aa9a2735db08e7f09f01ab I0326 23:35:41.441602 1 recorder.go:75] Recording config/node/ip-10-0-1-210.ec2.internal with fingerprint=4d741be006520f3374e351968afe0f58e1ce7348917d2b769af1340ea1279d05 I0326 23:35:41.441655 1 recorder.go:75] Recording config/node/ip-10-0-2-233.ec2.internal with fingerprint=783d8da775590f91c9f3afb498d978be4337902e213988b120061430aa6e52b3 I0326 23:35:41.441665 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 28.448006ms to process 3 records I0326 23:35:41.441730 1 recorder.go:75] Recording config/image with fingerprint=993e48efd5b17386c0d41936963911364bdb2288f98fb2514d70c0910a87dead I0326 23:35:41.441738 1 gather.go:177] gatherer "clusterconfig" function "image" took 26.50134ms to process 1 records I0326 23:35:41.441740 1 tasks_processing.go:74] worker 41 stopped. I0326 23:35:41.441811 1 tasks_processing.go:74] worker 22 stopped. I0326 23:35:41.442236 1 recorder.go:75] Recording config/infrastructure with fingerprint=f45cdfbe5ef3953383722cc3e61b680db01da19d6645b3307766b7aa07002a23 I0326 23:35:41.442247 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 27.452925ms to process 1 records I0326 23:35:41.444255 1 tasks_processing.go:74] worker 30 stopped. I0326 23:35:41.444276 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 29.725984ms to process 0 records I0326 23:35:41.444357 1 tasks_processing.go:74] worker 49 stopped. I0326 23:35:41.444366 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=4f57ff3d75e365aca7142bdedf2b641019b70f5ecabbaef5474bd9cdf9ed2865 I0326 23:35:41.444383 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=7cce524909781a7d0e418c426323c7e2349715b7a8681602f5c2aafccfe9c556 I0326 23:35:41.444395 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 30.254834ms to process 2 records E0326 23:35:41.444403 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0326 23:35:41.444408 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 29.92445ms to process 0 records I0326 23:35:41.444421 1 tasks_processing.go:74] worker 11 stopped. I0326 23:35:41.444475 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=45d0dfcda03c450b0b50b56a847f8ebc96a8e5ba00770f45819f27dcacaa809a I0326 23:35:41.444494 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=0317fd51bf226fa814c4b6e25833a355175423dd6a8aafeef0334d9be41db2eb I0326 23:35:41.444491 1 tasks_processing.go:74] worker 14 stopped. I0326 23:35:41.444509 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=2b50e4a5f358e27d193f4e58646b63a1d59c40249ca51e859a0baddb61c29f66 I0326 23:35:41.444519 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 30.795929ms to process 3 records I0326 23:35:41.444523 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 30.816674ms to process 0 records I0326 23:35:41.444530 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 30.818335ms to process 0 records I0326 23:35:41.444535 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 31.13528ms to process 0 records I0326 23:35:41.444536 1 tasks_processing.go:74] worker 26 stopped. I0326 23:35:41.444541 1 tasks_processing.go:74] worker 37 stopped. I0326 23:35:41.444571 1 tasks_processing.go:74] worker 36 stopped. W0326 23:35:41.445712 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0326 23:35:41.447580 1 tasks_processing.go:74] worker 20 stopped. I0326 23:35:41.447640 1 recorder.go:75] Recording config/running_containers with fingerprint=4549383f18acf72d2df0e2358e049f5e5750abe4e2857ec399fe2647887e10c4 I0326 23:35:41.447652 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 36.209561ms to process 1 records I0326 23:35:41.455863 1 tasks_processing.go:74] worker 47 stopped. I0326 23:35:41.455881 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 42.648183ms to process 0 records I0326 23:35:41.456059 1 tasks_processing.go:74] worker 23 stopped. I0326 23:35:41.456156 1 recorder.go:75] Recording config/olm_operators with fingerprint=e0beeedb8916eff7ff74d4379357982083ae85a9b614fa471fdb2e5edaf3d2ab I0326 23:35:41.456174 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 44.7311ms to process 1 records I0326 23:35:41.456259 1 tasks_processing.go:74] worker 59 stopped. I0326 23:35:41.456387 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0326 23:35:41.456411 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=942e91f11d7e3d904b8e02263c58a747db63ab95e5180d517278da611105e8e9 I0326 23:35:41.456436 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0326 23:35:41.456712 1 operator.go:288] started I0326 23:35:41.456827 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0326 23:35:41.456830 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=9fd5ca7c012f8f95bd3ee019caf99ea82caae7f4cd0a20812737b1e7a17424fa I0326 23:35:41.456956 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 41.583209ms to process 2 records I0326 23:35:41.457127 1 tasks_processing.go:74] worker 13 stopped. I0326 23:35:41.458734 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=2cd4d4d72ad4c5b3e770fcf65bc4270d6aa42fcc0cf85d4b9f67cb315dbccb9e I0326 23:35:41.458958 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=4f5e9dfc642de2fe2faf78323f1827737e292c68fd13e91fd634d63c16ed7f6b I0326 23:35:41.458968 1 gather.go:177] gatherer "clusterconfig" function "crds" took 44.037932ms to process 2 records I0326 23:35:41.459048 1 tasks_processing.go:74] worker 17 stopped. I0326 23:35:41.459147 1 recorder.go:75] Recording config/authentication with fingerprint=68451c35e1bcf87679344c567c33e3137748bacff9163c59a2c3a5b33c534626 I0326 23:35:41.459157 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 41.760237ms to process 1 records I0326 23:35:41.459244 1 tasks_processing.go:74] worker 56 stopped. I0326 23:35:41.459467 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=1171bceb7c2c20d6fcb3af9b72ed718d0f25821cb3a1ee0f7273b55714c4f833 I0326 23:35:41.459477 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 41.803968ms to process 1 records I0326 23:35:41.459485 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 45.524916ms to process 0 records I0326 23:35:41.459492 1 tasks_processing.go:74] worker 42 stopped. I0326 23:35:41.473840 1 prometheus_rules.go:88] Prometheus rules successfully created I0326 23:35:41.473914 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:35:41.473926 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:35:41.473931 1 controller.go:212] Source scaController *sca.Controller is not ready I0326 23:35:41.473934 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0326 23:35:41.473938 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:35:41.473955 1 controller.go:489] The operator is still being initialized I0326 23:35:41.473962 1 controller.go:512] The operator is healthy E0326 23:35:41.481037 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%279c0621cc-1b93-49d6-8682-2ef52ebe5a1c%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.14:60795->172.30.0.10:53: read: connection refused I0326 23:35:41.481053 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%279c0621cc-1b93-49d6-8682-2ef52ebe5a1c%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.14:60795->172.30.0.10:53: read: connection refused I0326 23:35:41.482417 1 tasks_processing.go:74] worker 51 stopped. E0326 23:35:41.482432 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0326 23:35:41.482440 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0326 23:35:41.482444 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0326 23:35:41.482455 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0326 23:35:41.482481 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0326 23:35:41.482488 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0326 23:35:41.482493 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0326 23:35:41.482497 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0326 23:35:41.482535 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0326 23:35:41.482542 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0326 23:35:41.482548 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 69.034376ms to process 7 records I0326 23:35:41.486898 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0326 23:35:41.486909 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0326 23:35:41.486944 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0326 23:35:41.490881 1 base_controller.go:82] Caches are synced for ConfigController I0326 23:35:41.490897 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0326 23:35:41.494552 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:35:41.500534 1 tasks_processing.go:74] worker 54 stopped. I0326 23:35:41.500585 1 gather_logs.go:145] no pods in namespace were found I0326 23:35:41.500829 1 recorder.go:75] Recording config/version with fingerprint=e0d9606a124d1dbdb9ec00ce0c677cabec978b3cf60654e0486413d0269867e1 I0326 23:35:41.500861 1 recorder.go:75] Recording config/id with fingerprint=55f6cc8d7e8936263d36845abc30ceed6dcfbde886f9d2aad3749c92eda95582 I0326 23:35:41.500870 1 gather.go:177] gatherer "clusterconfig" function "version" took 89.19543ms to process 2 records I0326 23:35:41.500882 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 86.135883ms to process 0 records I0326 23:35:41.500892 1 tasks_processing.go:74] worker 10 stopped. I0326 23:35:41.514299 1 tasks_processing.go:74] worker 48 stopped. I0326 23:35:41.514320 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 100.321418ms to process 0 records I0326 23:35:41.522477 1 tasks_processing.go:74] worker 4 stopped. I0326 23:35:41.522514 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0326 23:35:41.522525 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 111.113781ms to process 1 records I0326 23:35:41.522983 1 tasks_processing.go:74] worker 32 stopped. I0326 23:35:41.523015 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0326 23:35:41.523026 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 109.453944ms to process 1 records I0326 23:35:41.529055 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0326 23:35:41.532624 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.14:46205->172.30.0.10:53: read: connection refused I0326 23:35:41.532638 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.14:46205->172.30.0.10:53: read: connection refused I0326 23:35:41.557540 1 base_controller.go:82] Caches are synced for LoggingSyncer I0326 23:35:41.557565 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0326 23:35:41.574547 1 tasks_processing.go:74] worker 61 stopped. E0326 23:35:41.574573 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0326 23:35:41.574580 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2p9n1c8c9cfpj6p7b17r525iussa5smo-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2p9n1c8c9cfpj6p7b17r525iussa5smo-primary-cert-bundle-secret" not found I0326 23:35:41.574667 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=97af57f183ddd14e19d67cb5a2be8a79ecb5daae8e411819b8ca2d872c46fa7a I0326 23:35:41.574685 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 162.474482ms to process 1 records I0326 23:35:41.847613 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0326 23:35:41.847628 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0326 23:35:41.847813 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-dl7zb pod in namespace openshift-dns (previous: false). I0326 23:35:42.075274 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dl7zb pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-dl7zb\" is waiting to start: ContainerCreating" I0326 23:35:42.075291 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-dl7zb\" is waiting to start: ContainerCreating" I0326 23:35:42.075299 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-dl7zb pod in namespace openshift-dns (previous: false). I0326 23:35:42.252768 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dl7zb pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-dl7zb\" is waiting to start: ContainerCreating" I0326 23:35:42.252788 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-dl7zb\" is waiting to start: ContainerCreating" I0326 23:35:42.252803 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-mlpq5 pod in namespace openshift-dns (previous: false). W0326 23:35:42.444276 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0326 23:35:42.481474 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mlpq5 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-mlpq5\" is waiting to start: ContainerCreating" I0326 23:35:42.481491 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-mlpq5\" is waiting to start: ContainerCreating" I0326 23:35:42.481500 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-mlpq5 pod in namespace openshift-dns (previous: false). I0326 23:35:42.653725 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mlpq5 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-mlpq5\" is waiting to start: ContainerCreating" I0326 23:35:42.653746 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-mlpq5\" is waiting to start: ContainerCreating" I0326 23:35:42.653757 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vbh86 pod in namespace openshift-dns (previous: false). I0326 23:35:42.892492 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vbh86 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vbh86\" is waiting to start: ContainerCreating" I0326 23:35:42.892512 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vbh86\" is waiting to start: ContainerCreating" I0326 23:35:42.892520 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vbh86 pod in namespace openshift-dns (previous: false). I0326 23:35:43.058440 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vbh86 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vbh86\" is waiting to start: ContainerCreating" I0326 23:35:43.058458 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vbh86\" is waiting to start: ContainerCreating" I0326 23:35:43.058468 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-59dj7 pod in namespace openshift-dns (previous: false). I0326 23:35:43.075592 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0326 23:35:43.253150 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0326 23:35:43.253173 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-6vwgn pod in namespace openshift-dns (previous: false). W0326 23:35:43.444073 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0326 23:35:43.454235 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0326 23:35:43.454251 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-z85n7 pod in namespace openshift-dns (previous: false). I0326 23:35:43.476809 1 tasks_processing.go:74] worker 21 stopped. I0326 23:35:43.476877 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=9bb94c2510e35534a81d54fe908c31acd9f9bf22bcf0ee9f9df686fe1a4f7a84 I0326 23:35:43.476921 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=dba61ed60d403c6995c1282b599945e48f165b56cd7d07cbb07a0f386981f20d I0326 23:35:43.476955 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0326 23:35:43.476982 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=3f777e407cc5c3bd275c54db1b2db71751316a7e46ddd7c75076e477d35c71ea I0326 23:35:43.477001 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0326 23:35:43.477041 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=1544d0ffe72ea9784946aa4a332d0d44c4b813b6bc3786665d2f649bc76e7d87 I0326 23:35:43.477084 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=9e2e3ce8f25d95dcc404ea0b47077e1e65deb05da5330ff2b700ddd10d2c9005 I0326 23:35:43.477138 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=213098ab3a68315e1f8730dc14023220630844016f10c4290a8cc298e2cd8624 I0326 23:35:43.477190 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=035092f5c192bab9af73dee098098577e83e470b0bd6cfe28f26f42f3a3d3598 I0326 23:35:43.477204 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I0326 23:35:43.477230 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a22c855ca908ba47cc1374e0eba929f52d97e3d6afee27b93f30d698675f5d8a I0326 23:35:43.477243 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0326 23:35:43.477266 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=64c99f8617160b06befeb673b527b070aeee73333331cd4a39fb67d6c7cbdc66 I0326 23:35:43.477280 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0326 23:35:43.477303 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=233efebaa8bdf7601d94516205b0be62e72e773021b056d16651f4f418824d5d I0326 23:35:43.477314 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0326 23:35:43.477334 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=ac88f0f661341f4edc9fa85e576ae122f819cbafc704a1d9053b83b70ce524f8 I0326 23:35:43.477368 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0326 23:35:43.477397 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=dea9b1575ba1ab0592e48fdefbab870d9b010a8abd81d45b11eab6aef3c8bb3c I0326 23:35:43.477594 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=acb9059e77adb6ac2f47520060c18f790533fb459887a1bb453e26ae33d40be8 I0326 23:35:43.477609 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0326 23:35:43.477624 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0326 23:35:43.477670 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0326 23:35:43.477703 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=d6ccf51cd89d5889a85bda2c6a0456326e83623eb4e30eaac9cbfce515dbf719 I0326 23:35:43.477740 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=4b799542d4c48e8332c960c9c65fc0e1aebb0b511a3cc5b2a94bd627659369d0 I0326 23:35:43.477754 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0326 23:35:43.477778 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=fcfd7ff0d454f3d0b22e8b5cf9079553e926ae44f78452e8d03636f0c8a3589b I0326 23:35:43.477793 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0326 23:35:43.477813 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=77f37ca6120072a9bf5583653c53e636bf80a955e149a6957700417e56ccdcbe I0326 23:35:43.477836 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=ead7d4689a9ef2a1cbb48b22d5c01bd4d9682a45958c69a1b77c9a834ddf35cd I0326 23:35:43.477861 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=766a041001016bf05a20b7d75c2c108987bc1425290c78faf83af880a94808c1 I0326 23:35:43.477883 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=be01ac1ca35252078dab0d81bd837bd10fdd9fe836a2dc214832be2b6e8f3a0f I0326 23:35:43.477897 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=683d539c58c16f0287de79d9000d6f3a0225c2a71200f827bf84f7227b4080e3 I0326 23:35:43.477921 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=0b0bd408023093b85f7fc768bfcc829b27b7b95f8026d653764297b578c63a8d I0326 23:35:43.477937 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0326 23:35:43.477947 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0326 23:35:43.477955 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.062294321s to process 36 records I0326 23:35:43.653466 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0326 23:35:43.653520 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6b465cf48d-sg2gp pod in namespace openshift-image-registry (previous: false). I0326 23:35:43.853772 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6b465cf48d-sg2gp pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6b465cf48d-sg2gp\" is waiting to start: ContainerCreating" I0326 23:35:43.853792 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6b465cf48d-sg2gp\" is waiting to start: ContainerCreating" I0326 23:35:43.853828 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-78895c9fdc-6spsl pod in namespace openshift-image-registry (previous: false). I0326 23:35:44.052432 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-78895c9fdc-6spsl pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-78895c9fdc-6spsl\" is waiting to start: ContainerCreating" I0326 23:35:44.052449 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-78895c9fdc-6spsl\" is waiting to start: ContainerCreating" I0326 23:35:44.052479 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-78895c9fdc-vdlv8 pod in namespace openshift-image-registry (previous: false). I0326 23:35:44.254207 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-78895c9fdc-vdlv8 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-78895c9fdc-vdlv8\" is waiting to start: ContainerCreating" I0326 23:35:44.254226 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-78895c9fdc-vdlv8\" is waiting to start: ContainerCreating" I0326 23:35:44.254243 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5b9gt pod in namespace openshift-image-registry (previous: false). W0326 23:35:44.444736 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0326 23:35:44.456227 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0326 23:35:44.456247 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-vfj45 pod in namespace openshift-image-registry (previous: false). I0326 23:35:44.654223 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0326 23:35:44.654242 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-xx6l7 pod in namespace openshift-image-registry (previous: false). I0326 23:35:44.860208 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0326 23:35:44.860226 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-575f49d475-2v5bx pod in namespace openshift-ingress (previous: false). I0326 23:35:45.054667 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-575f49d475-2v5bx pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-575f49d475-2v5bx\" is waiting to start: ContainerCreating" I0326 23:35:45.054685 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-575f49d475-2v5bx\" is waiting to start: ContainerCreating" I0326 23:35:45.054695 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-575f49d475-99mpf pod in namespace openshift-ingress (previous: false). I0326 23:35:45.254244 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-575f49d475-99mpf pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-575f49d475-99mpf\" is waiting to start: ContainerCreating" I0326 23:35:45.254265 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-575f49d475-99mpf\" is waiting to start: ContainerCreating" I0326 23:35:45.254274 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-78845544f5-wm5m9 pod in namespace openshift-ingress (previous: false). W0326 23:35:45.443987 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0326 23:35:45.453237 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-78845544f5-wm5m9 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-78845544f5-wm5m9\" is waiting to start: ContainerCreating" I0326 23:35:45.453252 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-78845544f5-wm5m9\" is waiting to start: ContainerCreating" I0326 23:35:45.453263 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-d48hn pod in namespace openshift-ingress-canary (previous: false). I0326 23:35:45.654791 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-d48hn pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-d48hn\" is waiting to start: ContainerCreating" I0326 23:35:45.654810 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-d48hn\" is waiting to start: ContainerCreating" I0326 23:35:45.654821 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-lj4jj pod in namespace openshift-ingress-canary (previous: false). I0326 23:35:45.857601 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-lj4jj pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-lj4jj\" is waiting to start: ContainerCreating" I0326 23:35:45.857621 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-lj4jj\" is waiting to start: ContainerCreating" I0326 23:35:45.857632 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-pvdch pod in namespace openshift-ingress-canary (previous: false). I0326 23:35:46.053797 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-pvdch pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-pvdch\" is waiting to start: ContainerCreating" I0326 23:35:46.053814 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-pvdch\" is waiting to start: ContainerCreating" I0326 23:35:46.053832 1 tasks_processing.go:74] worker 5 stopped. I0326 23:35:46.053936 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=b0f1cd316b1062cf4097bc0c3bac87f15c9c8288658cfbab4817f15f189125da I0326 23:35:46.053990 1 recorder.go:75] Recording events/openshift-dns with fingerprint=6c667c84155b4d2f6b1602e8c9363669281384e400012628daa8183ad3a5be5e I0326 23:35:46.054079 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=0ea7cf0594e1730a1d7b984249cfc4d1969caab52b1ba5bbb3fefab5295e4923 I0326 23:35:46.054121 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=6162f3029219a41eafeec34de03f542d39904b9be19ce01c7b1fc3f3aa828bf5 I0326 23:35:46.054168 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=b009c0ecdf5b45b2145c5e9005b94bc2aab75d3427ff6203648677b77e4f6ad3 I0326 23:35:46.054186 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=c1ae48bd5af7547d3fcf1c205472a20bce2103f0b046b51cfa8e0d365411f7b6 I0326 23:35:46.055532 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6b465cf48d-sg2gp with fingerprint=6b31e9f284dd8dbd0300babe18c407cb25cae19a73cfc5780e896e791066a939 I0326 23:35:46.055651 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-78895c9fdc-6spsl with fingerprint=20bac5f98462ee014a16cb429b3bd0dd48e48d32f87e16ae170b340bd1388633 I0326 23:35:46.055740 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-78895c9fdc-vdlv8 with fingerprint=ac8cadb17d01530dbe8f1e0d9573490797add502f5d01aba809123e897b3c5d2 I0326 23:35:46.055751 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.642623754s to process 9 records W0326 23:35:46.440907 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0326 23:35:46.440933 1 tasks_processing.go:74] worker 45 stopped. E0326 23:35:46.440953 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0326 23:35:46.440972 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0326 23:35:46.440989 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0326 23:35:46.441006 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.028087273s to process 1 records I0326 23:35:53.847724 1 tasks_processing.go:74] worker 18 stopped. I0326 23:35:53.847767 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0326 23:35:53.847780 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.435492076s to process 1 records I0326 23:35:54.611837 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:35:54.616955 1 tasks_processing.go:74] worker 28 stopped. I0326 23:35:54.617241 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=751aa8b7d1208af5fd734152a53c8f2354708612b0cd50cfd9c595651a5cc8c8 I0326 23:35:54.617261 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.205537262s to process 1 records E0326 23:35:54.617319 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.206s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0326 23:35:54.618421 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0326 23:35:54.618434 1 periodic.go:209] Running workloads gatherer I0326 23:35:54.618450 1 tasks_processing.go:45] number of workers: 2 I0326 23:35:54.618459 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:35:54.618463 1 tasks_processing.go:71] worker 1 working on workload_info task. I0326 23:35:54.618472 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:35:54.618484 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0326 23:35:54.640556 1 tasks_processing.go:74] worker 0 stopped. I0326 23:35:54.640576 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 22.058003ms to process 0 records I0326 23:35:54.642129 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0326 23:35:54.650337 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (9ms) I0326 23:35:54.658068 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0326 23:35:54.665599 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (8ms) I0326 23:35:54.673373 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (8ms) I0326 23:35:54.681625 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (8ms) I0326 23:35:54.689742 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (8ms) I0326 23:35:54.696639 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (7ms) I0326 23:35:54.704818 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (8ms) I0326 23:35:54.711937 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (7ms) I0326 23:35:54.719301 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (7ms) I0326 23:35:54.748753 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (29ms) I0326 23:35:54.850501 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (102ms) I0326 23:35:54.951466 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (101ms) I0326 23:35:55.051630 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0326 23:35:55.150585 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (99ms) I0326 23:35:55.252036 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (101ms) I0326 23:35:55.350990 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0326 23:35:55.450913 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (100ms) I0326 23:35:55.550422 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (99ms) I0326 23:35:55.651323 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (101ms) I0326 23:35:55.750818 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (99ms) I0326 23:35:55.850751 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (100ms) I0326 23:35:55.951096 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0326 23:35:56.051621 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0326 23:35:56.150668 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (99ms) I0326 23:35:56.250495 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0326 23:35:56.350536 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0326 23:35:56.450506 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0326 23:35:56.550781 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (100ms) I0326 23:35:56.650831 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0326 23:35:56.751278 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0326 23:35:56.850196 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (99ms) I0326 23:35:56.850230 1 tasks_processing.go:74] worker 1 stopped. E0326 23:35:56.850241 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0326 23:35:56.850612 1 recorder.go:75] Recording config/workload_info with fingerprint=8424b4684dfa48b48cfeacf6b51e0af3c0dd2587c2061b4beeb579d5bf2bb61e I0326 23:35:56.850630 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.231760561s to process 1 records E0326 23:35:56.850654 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.232s with: function \"workload_info\" failed with an error" I0326 23:35:56.851758 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0326 23:35:56.851770 1 periodic.go:209] Running conditional gatherer I0326 23:35:56.857603 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0326 23:35:56.863950 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.14:54347->172.30.0.10:53: read: connection refused E0326 23:35:56.864231 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0326 23:35:56.864297 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0326 23:35:56.868843 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0326 23:35:56.868858 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:35:56.868863 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:35:56.868867 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:35:56.868870 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:35:56.868873 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:35:56.868876 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:35:56.868879 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:35:56.868882 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:35:56.868885 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0326 23:35:56.868900 1 tasks_processing.go:45] number of workers: 3 I0326 23:35:56.868911 1 tasks_processing.go:69] worker 2 listening for tasks. I0326 23:35:56.868915 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0326 23:35:56.868922 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:35:56.868936 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0326 23:35:56.868935 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:35:56.868941 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0326 23:35:56.868946 1 tasks_processing.go:74] worker 1 stopped. I0326 23:35:56.868998 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0326 23:35:56.869011 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 931ns to process 1 records I0326 23:35:56.869043 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0326 23:35:56.869051 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.198µs to process 1 records I0326 23:35:56.869058 1 tasks_processing.go:74] worker 0 stopped. I0326 23:35:56.869200 1 tasks_processing.go:74] worker 2 stopped. I0326 23:35:56.869212 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 252.752µs to process 0 records I0326 23:35:56.869231 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.14:54347->172.30.0.10:53: read: connection refused I0326 23:35:56.869249 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0326 23:35:56.891009 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=e0bc3fd995d6bd82bdc9643b4f7865e20f545a7c86c6e48e0c94cf2c77a23c79 I0326 23:35:56.891213 1 diskrecorder.go:70] Writing 104 records to /var/lib/insights-operator/insights-2026-03-26-233556.tar.gz I0326 23:35:56.898221 1 diskrecorder.go:51] Wrote 104 records to disk in 7ms I0326 23:35:56.898259 1 periodic.go:278] Gathering cluster info every 2h0m0s I0326 23:35:56.898276 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0326 23:35:57.395061 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:35:57.593739 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:36:09.146248 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:36:45.701291 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="6804b817efade85fe9590bd644a81386c6c4549bfd09cc96b9caf00830b71204") W0326 23:36:45.701323 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0326 23:36:45.701395 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="3829a01170adbe1de9c40747dafe60a5aab9e6216c799c0502106db495362bd0") I0326 23:36:45.701408 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0326 23:36:45.701431 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0326 23:36:45.701444 1 base_controller.go:181] Shutting down ConfigController ... I0326 23:36:45.701456 1 periodic.go:170] Shutting down I0326 23:36:45.701468 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0326 23:36:45.701476 1 base_controller.go:113] All ConfigController workers have been terminated I0326 23:36:45.701473 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0326 23:36:45.701482 1 base_controller.go:181] Shutting down LoggingSyncer ... I0326 23:36:45.701502 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0326 23:36:45.701506 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="e5ac4407a3fc235dcde5d6dc051718944739b5842a87f19399a97b72ed2f284b") I0326 23:36:45.701509 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0326 23:36:45.701518 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0326 23:36:45.701524 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController" I0326 23:36:45.701525 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0326 23:36:45.701538 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I0326 23:36:45.701548 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain"