W0417 18:43:16.927916 1 cmd.go:257] Using insecure, self-signed certificates I0417 18:43:17.406893 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:43:17.407192 1 observer_polling.go:159] Starting file observer I0417 18:43:18.698406 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0417 18:43:18.698589 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0417 18:43:18.699174 1 secure_serving.go:57] Forcing use of http/1.1 only I0417 18:43:18.699185 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0417 18:43:18.699196 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0417 18:43:18.699201 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0417 18:43:18.699205 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0417 18:43:18.699207 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0417 18:43:18.699210 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0417 18:43:18.699212 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0417 18:43:18.702850 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0417 18:43:18.702857 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"6112292b-91f0-46fe-9c2e-6446b08b176b", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0417 18:43:18.704205 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0417 18:43:18.704209 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0417 18:43:18.704241 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0417 18:43:18.704243 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0417 18:43:18.704214 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0417 18:43:18.704486 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0417 18:43:18.704678 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3308850793/tls.crt::/tmp/serving-cert-3308850793/tls.key" I0417 18:43:18.704977 1 secure_serving.go:213] Serving securely on [::]:8443 I0417 18:43:18.705020 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0417 18:43:18.712199 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0417 18:43:18.712221 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0417 18:43:18.712324 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0417 18:43:18.717365 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0417 18:43:18.717382 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0417 18:43:18.722148 1 secretconfigobserver.go:119] support secret does not exist I0417 18:43:18.729832 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0417 18:43:18.737101 1 secretconfigobserver.go:119] support secret does not exist I0417 18:43:18.737365 1 recorder.go:161] Pruning old reports every 5h5m32s, max age is 288h0m0s I0417 18:43:18.742201 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0417 18:43:18.742209 1 periodic.go:209] Running clusterconfig gatherer I0417 18:43:18.742220 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0417 18:43:18.742239 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0417 18:43:18.742243 1 insightsreport.go:296] Starting report retriever I0417 18:43:18.742245 1 tasks_processing.go:45] number of workers: 64 I0417 18:43:18.742247 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0417 18:43:18.742256 1 tasks_processing.go:69] worker 1 listening for tasks. I0417 18:43:18.742264 1 tasks_processing.go:69] worker 9 listening for tasks. I0417 18:43:18.742272 1 tasks_processing.go:69] worker 2 listening for tasks. I0417 18:43:18.742273 1 tasks_processing.go:69] worker 21 listening for tasks. I0417 18:43:18.742272 1 tasks_processing.go:69] worker 0 listening for tasks. I0417 18:43:18.742281 1 tasks_processing.go:71] worker 21 working on nodes task. I0417 18:43:18.742286 1 tasks_processing.go:71] worker 0 working on sap_datahubs task. I0417 18:43:18.742293 1 tasks_processing.go:69] worker 12 listening for tasks. I0417 18:43:18.742294 1 tasks_processing.go:69] worker 23 listening for tasks. I0417 18:43:18.742303 1 tasks_processing.go:69] worker 14 listening for tasks. I0417 18:43:18.742304 1 tasks_processing.go:69] worker 8 listening for tasks. I0417 18:43:18.742293 1 tasks_processing.go:69] worker 47 listening for tasks. I0417 18:43:18.742306 1 tasks_processing.go:69] worker 29 listening for tasks. I0417 18:43:18.742313 1 tasks_processing.go:69] worker 25 listening for tasks. I0417 18:43:18.742279 1 tasks_processing.go:69] worker 28 listening for tasks. I0417 18:43:18.742320 1 tasks_processing.go:69] worker 27 listening for tasks. I0417 18:43:18.742320 1 tasks_processing.go:69] worker 30 listening for tasks. I0417 18:43:18.742321 1 tasks_processing.go:69] worker 6 listening for tasks. I0417 18:43:18.742329 1 tasks_processing.go:69] worker 19 listening for tasks. I0417 18:43:18.742330 1 tasks_processing.go:69] worker 32 listening for tasks. I0417 18:43:18.742330 1 tasks_processing.go:69] worker 20 listening for tasks. I0417 18:43:18.742335 1 tasks_processing.go:69] worker 18 listening for tasks. I0417 18:43:18.742298 1 tasks_processing.go:69] worker 5 listening for tasks. I0417 18:43:18.742333 1 tasks_processing.go:69] worker 26 listening for tasks. I0417 18:43:18.742343 1 tasks_processing.go:69] worker 57 listening for tasks. I0417 18:43:18.742347 1 tasks_processing.go:71] worker 25 working on infrastructures task. I0417 18:43:18.742350 1 tasks_processing.go:71] worker 26 working on ingress task. I0417 18:43:18.742355 1 tasks_processing.go:69] worker 48 listening for tasks. I0417 18:43:18.742356 1 tasks_processing.go:69] worker 53 listening for tasks. I0417 18:43:18.742360 1 tasks_processing.go:69] worker 45 listening for tasks. I0417 18:43:18.742336 1 tasks_processing.go:71] worker 19 working on ceph_cluster task. I0417 18:43:18.742365 1 tasks_processing.go:69] worker 54 listening for tasks. I0417 18:43:18.742371 1 tasks_processing.go:69] worker 46 listening for tasks. I0417 18:43:18.742368 1 tasks_processing.go:69] worker 36 listening for tasks. I0417 18:43:18.742364 1 tasks_processing.go:69] worker 35 listening for tasks. I0417 18:43:18.742299 1 tasks_processing.go:69] worker 13 listening for tasks. I0417 18:43:18.742360 1 tasks_processing.go:69] worker 44 listening for tasks. I0417 18:43:18.742386 1 tasks_processing.go:69] worker 51 listening for tasks. I0417 18:43:18.742388 1 tasks_processing.go:69] worker 39 listening for tasks. I0417 18:43:18.742389 1 tasks_processing.go:71] worker 18 working on mutating_webhook_configurations task. I0417 18:43:18.742395 1 tasks_processing.go:69] worker 41 listening for tasks. I0417 18:43:18.742396 1 tasks_processing.go:69] worker 61 listening for tasks. I0417 18:43:18.742396 1 tasks_processing.go:69] worker 59 listening for tasks. I0417 18:43:18.742391 1 tasks_processing.go:69] worker 58 listening for tasks. I0417 18:43:18.742404 1 tasks_processing.go:69] worker 60 listening for tasks. I0417 18:43:18.742403 1 tasks_processing.go:71] worker 61 working on validating_webhook_configurations task. I0417 18:43:18.742407 1 tasks_processing.go:71] worker 28 working on openshift_machine_api_events task. I0417 18:43:18.742414 1 tasks_processing.go:71] worker 36 working on qemu_kubevirt_launcher_logs task. I0417 18:43:18.742417 1 tasks_processing.go:71] worker 53 working on container_images task. I0417 18:43:18.742309 1 tasks_processing.go:69] worker 15 listening for tasks. I0417 18:43:18.742995 1 tasks_processing.go:69] worker 63 listening for tasks. I0417 18:43:18.742328 1 tasks_processing.go:71] worker 30 working on active_alerts task. I0417 18:43:18.743098 1 tasks_processing.go:71] worker 2 working on clusterroles task. I0417 18:43:18.743113 1 tasks_processing.go:71] worker 9 working on machines task. I0417 18:43:18.742349 1 tasks_processing.go:71] worker 5 working on sap_config task. W0417 18:43:18.743160 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:43:18.743181 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 83.466µs to process 0 records I0417 18:43:18.742338 1 tasks_processing.go:71] worker 32 working on sap_pods task. I0417 18:43:18.743205 1 tasks_processing.go:71] worker 30 working on config_maps task. I0417 18:43:18.743288 1 tasks_processing.go:71] worker 60 working on lokistack task. I0417 18:43:18.742421 1 tasks_processing.go:71] worker 1 working on storage_cluster task. I0417 18:43:18.742287 1 tasks_processing.go:69] worker 11 listening for tasks. I0417 18:43:18.743930 1 tasks_processing.go:71] worker 51 working on proxies task. I0417 18:43:18.742282 1 tasks_processing.go:69] worker 10 listening for tasks. I0417 18:43:18.742288 1 tasks_processing.go:69] worker 22 listening for tasks. I0417 18:43:18.742280 1 tasks_processing.go:69] worker 3 listening for tasks. I0417 18:43:18.742325 1 tasks_processing.go:69] worker 31 listening for tasks. I0417 18:43:18.742325 1 tasks_processing.go:69] worker 17 listening for tasks. I0417 18:43:18.742331 1 tasks_processing.go:71] worker 6 working on machine_sets task. I0417 18:43:18.744007 1 tasks_processing.go:71] worker 15 working on openshift_logging task. I0417 18:43:18.744054 1 tasks_processing.go:71] worker 58 working on aggregated_monitoring_cr_names task. I0417 18:43:18.742416 1 tasks_processing.go:71] worker 48 working on openstack_dataplanedeployments task. I0417 18:43:18.744238 1 tasks_processing.go:71] worker 10 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0417 18:43:18.744290 1 tasks_processing.go:71] worker 31 working on pdbs task. I0417 18:43:18.744332 1 tasks_processing.go:71] worker 63 working on authentication task. I0417 18:43:18.742286 1 tasks_processing.go:69] worker 4 listening for tasks. I0417 18:43:18.742339 1 tasks_processing.go:69] worker 40 listening for tasks. I0417 18:43:18.742385 1 tasks_processing.go:71] worker 20 working on image_pruners task. I0417 18:43:18.742335 1 tasks_processing.go:71] worker 23 working on ingress_certificates task. I0417 18:43:18.742338 1 tasks_processing.go:71] worker 14 working on openstack_controlplanes task. I0417 18:43:18.742308 1 tasks_processing.go:69] worker 24 listening for tasks. I0417 18:43:18.742340 1 tasks_processing.go:71] worker 8 working on metrics task. I0417 18:43:18.742342 1 tasks_processing.go:71] worker 47 working on crds task. I0417 18:43:18.742345 1 tasks_processing.go:71] worker 29 working on container_runtime_configs task. I0417 18:43:18.744083 1 tasks_processing.go:71] worker 11 working on machine_config_pools task. I0417 18:43:18.744297 1 tasks_processing.go:71] worker 3 working on dvo_metrics task. I0417 18:43:18.744153 1 tasks_processing.go:71] worker 22 working on jaegers task. I0417 18:43:18.742346 1 tasks_processing.go:69] worker 52 listening for tasks. I0417 18:43:18.744664 1 tasks_processing.go:71] worker 40 working on oauths task. W0417 18:43:18.744747 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:43:18.742421 1 tasks_processing.go:71] worker 57 working on monitoring_persistent_volumes task. I0417 18:43:18.744769 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 296.786µs to process 0 records I0417 18:43:18.744796 1 tasks_processing.go:71] worker 52 working on node_logs task. I0417 18:43:18.742359 1 tasks_processing.go:69] worker 34 listening for tasks. I0417 18:43:18.742372 1 tasks_processing.go:69] worker 49 listening for tasks. I0417 18:43:18.742372 1 tasks_processing.go:69] worker 37 listening for tasks. I0417 18:43:18.742377 1 tasks_processing.go:69] worker 55 listening for tasks. I0417 18:43:18.742379 1 tasks_processing.go:69] worker 50 listening for tasks. I0417 18:43:18.742310 1 tasks_processing.go:69] worker 7 listening for tasks. I0417 18:43:18.742380 1 tasks_processing.go:69] worker 38 listening for tasks. I0417 18:43:18.742378 1 tasks_processing.go:69] worker 62 listening for tasks. I0417 18:43:18.742385 1 tasks_processing.go:69] worker 56 listening for tasks. I0417 18:43:18.742403 1 tasks_processing.go:71] worker 41 working on operators task. I0417 18:43:18.742404 1 tasks_processing.go:69] worker 42 listening for tasks. I0417 18:43:18.742408 1 tasks_processing.go:71] worker 46 working on silenced_alerts task. I0417 18:43:18.742411 1 tasks_processing.go:71] worker 13 working on nodenetworkstates task. I0417 18:43:18.742403 1 tasks_processing.go:71] worker 54 working on olm_operators task. I0417 18:43:18.742412 1 tasks_processing.go:71] worker 44 working on support_secret task. I0417 18:43:18.742411 1 tasks_processing.go:69] worker 43 listening for tasks. I0417 18:43:18.742917 1 tasks_processing.go:71] worker 39 working on machine_healthchecks task. I0417 18:43:18.742979 1 tasks_processing.go:71] worker 45 working on version task. I0417 18:43:18.744118 1 tasks_processing.go:71] worker 59 working on machine_autoscalers task. I0417 18:43:18.744122 1 tasks_processing.go:71] worker 35 working on service_accounts task. I0417 18:43:18.742313 1 tasks_processing.go:69] worker 16 listening for tasks. I0417 18:43:18.744174 1 tasks_processing.go:71] worker 17 working on operators_pods_and_events task. I0417 18:43:18.745456 1 tasks_processing.go:71] worker 50 working on openstack_dataplanenodesets task. I0417 18:43:18.745478 1 tasks_processing.go:71] worker 7 working on cost_management_metrics_configs task. I0417 18:43:18.745525 1 tasks_processing.go:71] worker 55 working on networks task. I0417 18:43:18.745539 1 tasks_processing.go:71] worker 56 working on image task. I0417 18:43:18.745548 1 tasks_processing.go:71] worker 24 working on feature_gates task. I0417 18:43:18.742331 1 tasks_processing.go:71] worker 12 working on cluster_apiserver task. I0417 18:43:18.744477 1 tasks_processing.go:71] worker 27 working on schedulers task. I0417 18:43:18.742350 1 tasks_processing.go:69] worker 33 listening for tasks. I0417 18:43:18.745816 1 tasks_processing.go:74] worker 33 stopped. I0417 18:43:18.744946 1 tasks_processing.go:71] worker 8 working on storage_classes task. I0417 18:43:18.745439 1 tasks_processing.go:71] worker 16 working on pod_network_connectivity_checks task. I0417 18:43:18.745887 1 tasks_processing.go:71] worker 34 working on nodenetworkconfigurationpolicies task. I0417 18:43:18.745892 1 tasks_processing.go:71] worker 4 working on openstack_version task. I0417 18:43:18.745981 1 tasks_processing.go:71] worker 37 working on machine_configs task. I0417 18:43:18.745992 1 tasks_processing.go:71] worker 38 working on certificate_signing_requests task. I0417 18:43:18.746014 1 tasks_processing.go:71] worker 49 working on image_registries task. I0417 18:43:18.746027 1 tasks_processing.go:71] worker 62 working on overlapping_namespace_uids task. I0417 18:43:18.746044 1 tasks_processing.go:71] worker 42 working on tsdb_status task. W0417 18:43:18.746080 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0417 18:43:18.746082 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:43:18.746091 1 tasks_processing.go:74] worker 46 stopped. I0417 18:43:18.746100 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.126716ms to process 0 records I0417 18:43:18.746107 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 35.388µs to process 0 records I0417 18:43:18.746111 1 tasks_processing.go:74] worker 42 stopped. I0417 18:43:18.746292 1 tasks_processing.go:71] worker 43 working on install_plans task. I0417 18:43:18.746431 1 tasks_processing.go:74] worker 0 stopped. I0417 18:43:18.746445 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 4.134652ms to process 0 records I0417 18:43:18.747442 1 tasks_processing.go:74] worker 60 stopped. I0417 18:43:18.747454 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 4.140775ms to process 0 records I0417 18:43:18.747461 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 5.090761ms to process 0 records I0417 18:43:18.747466 1 tasks_processing.go:74] worker 19 stopped. I0417 18:43:18.748954 1 tasks_processing.go:74] worker 32 stopped. I0417 18:43:18.748965 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 5.748847ms to process 0 records I0417 18:43:18.749160 1 tasks_processing.go:74] worker 9 stopped. E0417 18:43:18.749172 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0417 18:43:18.749180 1 gather.go:177] gatherer "clusterconfig" function "machines" took 6.012094ms to process 0 records I0417 18:43:18.749928 1 tasks_processing.go:74] worker 15 stopped. I0417 18:43:18.749938 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 5.90283ms to process 0 records I0417 18:43:18.750313 1 tasks_processing.go:74] worker 59 stopped. I0417 18:43:18.750326 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 5.257752ms to process 0 records I0417 18:43:18.758027 1 tasks_processing.go:74] worker 48 stopped. I0417 18:43:18.758039 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 13.840006ms to process 0 records I0417 18:43:18.758124 1 tasks_processing.go:74] worker 50 stopped. I0417 18:43:18.758135 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 12.652462ms to process 0 records I0417 18:43:18.758141 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 12.629004ms to process 0 records I0417 18:43:18.758145 1 tasks_processing.go:74] worker 7 stopped. I0417 18:43:18.759551 1 tasks_processing.go:74] worker 6 stopped. I0417 18:43:18.759562 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 15.571324ms to process 0 records I0417 18:43:18.759632 1 tasks_processing.go:74] worker 16 stopped. E0417 18:43:18.759644 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0417 18:43:18.759656 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 13.777398ms to process 0 records I0417 18:43:18.759682 1 tasks_processing.go:74] worker 29 stopped. I0417 18:43:18.759694 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.206837ms to process 0 records I0417 18:43:18.759819 1 tasks_processing.go:74] worker 5 stopped. I0417 18:43:18.759832 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 16.649009ms to process 0 records I0417 18:43:18.759908 1 tasks_processing.go:74] worker 14 stopped. I0417 18:43:18.759918 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 15.438971ms to process 0 records I0417 18:43:18.766809 1 tasks_processing.go:74] worker 22 stopped. I0417 18:43:18.766823 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 22.320792ms to process 0 records I0417 18:43:18.766869 1 tasks_processing.go:74] worker 51 stopped. I0417 18:43:18.766992 1 recorder.go:75] Recording config/proxy with fingerprint=853d5bb0c27650a87c2c8eb128c4130b1a9ade81b6584d7ab038ea5d8d88a94d I0417 18:43:18.767006 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 22.920929ms to process 1 records I0417 18:43:18.767111 1 tasks_processing.go:74] worker 34 stopped. I0417 18:43:18.767126 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 21.20935ms to process 0 records I0417 18:43:18.767160 1 tasks_processing.go:74] worker 4 stopped. I0417 18:43:18.767168 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 21.207435ms to process 0 records I0417 18:43:18.767185 1 tasks_processing.go:74] worker 1 stopped. I0417 18:43:18.767192 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 23.42198ms to process 0 records I0417 18:43:18.767274 1 tasks_processing.go:74] worker 24 stopped. I0417 18:43:18.767298 1 recorder.go:75] Recording config/featuregate with fingerprint=f04ab0bb5949b409da7cbcdaf156a2540850cff3f1b7c552897b5222a6b32b25 I0417 18:43:18.767309 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 21.63931ms to process 1 records I0417 18:43:18.767343 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0417 18:43:18.767358 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0417 18:43:18.767363 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0417 18:43:18.767366 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0417 18:43:18.767380 1 controller.go:489] The operator is still being initialized I0417 18:43:18.767386 1 controller.go:512] The operator is healthy I0417 18:43:18.767464 1 tasks_processing.go:74] worker 63 stopped. I0417 18:43:18.767647 1 recorder.go:75] Recording config/authentication with fingerprint=4fc7daae4b49d5db608fac5ccb636db44bd0fd34aa717465d756f3bdef58482b I0417 18:43:18.767662 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 22.994247ms to process 1 records I0417 18:43:18.769128 1 tasks_processing.go:74] worker 25 stopped. I0417 18:43:18.769648 1 recorder.go:75] Recording config/infrastructure with fingerprint=9c0940505a4e1adf4e914e14e0c628e94077b015f34ba783342187f8fbefe62c I0417 18:43:18.769664 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 26.76925ms to process 1 records I0417 18:43:18.769849 1 tasks_processing.go:74] worker 26 stopped. I0417 18:43:18.769954 1 recorder.go:75] Recording config/ingress with fingerprint=d0ef02dfcb0b5a7878278f86a26548f71a70aedaa7d580791beb5ba13e935b2a I0417 18:43:18.769962 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 27.48321ms to process 1 records I0417 18:43:18.771901 1 tasks_processing.go:74] worker 18 stopped. I0417 18:43:18.772095 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=1dd3bc7d7c56e0ba027001626e220dd1d7c2f0ba05a654831a271f5883523ff1 I0417 18:43:18.772129 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=a5a6d59bcfdc4c9048965b8fe4ccdfb63f63e80cf5e7e2c33ba2c9a633d7fa45 I0417 18:43:18.772166 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=25098a53c47258b3761032cc7f5b91a8b69d64ec6fb14fa941cb039dfe00f6b5 I0417 18:43:18.772182 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 29.500474ms to process 3 records I0417 18:43:18.772262 1 recorder.go:75] Recording config/image with fingerprint=0511f15e82a51b610a85160e87e6fe5987b878c91d836457da686f6dc8d8a0cd I0417 18:43:18.772266 1 tasks_processing.go:74] worker 56 stopped. I0417 18:43:18.772275 1 gather.go:177] gatherer "clusterconfig" function "image" took 26.440872ms to process 1 records I0417 18:43:18.772348 1 tasks_processing.go:74] worker 20 stopped. I0417 18:43:18.772442 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=83c5da2a741890a32c77d2f221ef2e5ab0997eb72f97f7d542a3062a180245c8 I0417 18:43:18.772450 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 27.57028ms to process 1 records I0417 18:43:18.772529 1 tasks_processing.go:74] worker 12 stopped. I0417 18:43:18.772540 1 recorder.go:75] Recording config/apiserver with fingerprint=a7f684a001e42d46eda155c55643acc34e8cb4419319e7e79dab6352babf7e71 I0417 18:43:18.772545 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 26.557495ms to process 1 records I0417 18:43:18.772554 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 27.295668ms to process 0 records I0417 18:43:18.772561 1 tasks_processing.go:74] worker 13 stopped. I0417 18:43:18.773540 1 tasks_processing.go:74] worker 31 stopped. I0417 18:43:18.773720 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=dc3c96fcdbc963921fb3ff516ec4a588a474976aa0499bb70a94d286e761ea63 I0417 18:43:18.773750 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=70d1323dab21d5a0ccc33b2e61297b3f82f5a19ae51524f5f6ed1e37015ab334 I0417 18:43:18.773773 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=69fd0279a25152ca1792cb53d1816362dea140b1fe103a0bf8a2e3fdbc569c44 I0417 18:43:18.773792 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 29.202747ms to process 3 records I0417 18:43:18.773960 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=4fb82c9dead470549d9f2bbba2b0633ac815da0139b387a42ec141dea5bbe981 I0417 18:43:18.774105 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=f8a3f83230967d0f48103529267d9165bab5a1a7db961824036dfb32c1eef292 I0417 18:43:18.774136 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=8083f8130d4e4a46fb989432bc1b329c712b29c2c5d3fc8017090e647784614e I0417 18:43:18.774178 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=9ef3fa62d51113a1b51eae2ff8ef737dc10269a8d97d3a80accad804d5a62f04 I0417 18:43:18.774222 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=08e6d477f5d65421739b5108e088691373bdfd009ead2f81cfcf52d5b48b5d97 I0417 18:43:18.774285 1 tasks_processing.go:74] worker 61 stopped. I0417 18:43:18.774300 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=f128b5384110795a5883d9fa76aa28746106f824475ded6ead3bfcfe86fa4862 I0417 18:43:18.774369 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=2caf8b426b5c3efd78ee8de7b1d74fbfd85ba09e1c23ba918860e3d4d51b93ee I0417 18:43:18.774753 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=acd9a52b19e105b9ba81ccffe202bd43eddd9b2dc1482c4e5ba81bcafcf3e631 I0417 18:43:18.774805 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=0db3c2df32897de062dd2b7a78888c37f1d338d1c9a7c719d73370839d3b4621 I0417 18:43:18.774830 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=2125d89b5c08414380e99e3121e798a29adc064c6e64d8f8c31111c767189a03 I0417 18:43:18.774854 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=228066c01a441c926081427c652abcf09a80a29f7f5ee1f69800973a248c2820 I0417 18:43:18.774860 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 31.270841ms to process 11 records I0417 18:43:18.774940 1 tasks_processing.go:74] worker 49 stopped. I0417 18:43:18.775191 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=537ff771a286baccfa7d0d4bf042b4c29a1b77c4aecaae9ffe38ed2a17e3bd70 I0417 18:43:18.775201 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 28.328714ms to process 1 records I0417 18:43:18.775423 1 tasks_processing.go:74] worker 40 stopped. I0417 18:43:18.775600 1 recorder.go:75] Recording config/oauth with fingerprint=9221498b2f2ce6e3d36f0e3e09f370578c64eeef506ecf7f0633741eee774c28 I0417 18:43:18.775615 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 30.739362ms to process 1 records I0417 18:43:18.778712 1 gather_logs.go:145] no pods in namespace were found I0417 18:43:18.778726 1 tasks_processing.go:74] worker 36 stopped. I0417 18:43:18.778733 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 36.301655ms to process 0 records I0417 18:43:18.779275 1 tasks_processing.go:74] worker 55 stopped. I0417 18:43:18.779385 1 recorder.go:75] Recording config/network with fingerprint=9159822f6f93084ae4519bfe97b0b1e199742a45ca6eed7154e3669cd77f24b7 I0417 18:43:18.779397 1 gather.go:177] gatherer "clusterconfig" function "networks" took 33.733773ms to process 1 records I0417 18:43:18.779569 1 tasks_processing.go:74] worker 8 stopped. I0417 18:43:18.779649 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=722a82dfd8f311adaf15155523c4331ea36c54700e80f1ac2eccfa459bae23d7 I0417 18:43:18.779671 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=0799290ae1e3fb865ddb5478cf61241689a411ab415f67abefebf87aa384c10b I0417 18:43:18.779676 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 33.743214ms to process 2 records E0417 18:43:18.779683 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0417 18:43:18.779689 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 34.571824ms to process 0 records I0417 18:43:18.779695 1 tasks_processing.go:74] worker 39 stopped. I0417 18:43:18.779778 1 tasks_processing.go:74] worker 28 stopped. I0417 18:43:18.779793 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 37.355565ms to process 0 records I0417 18:43:18.780851 1 tasks_processing.go:74] worker 27 stopped. I0417 18:43:18.780917 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=c69faac5e59ab5d46b7e8a14adc35f1e9c5b55a901d6e3ccbee330bd71dfd46f I0417 18:43:18.780933 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 35.139867ms to process 1 records I0417 18:43:18.782280 1 tasks_processing.go:74] worker 62 stopped. I0417 18:43:18.782301 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0417 18:43:18.782309 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 36.238988ms to process 1 records I0417 18:43:18.783175 1 tasks_processing.go:74] worker 44 stopped. E0417 18:43:18.783215 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0417 18:43:18.783224 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 38.186257ms to process 0 records I0417 18:43:18.785485 1 tasks_processing.go:74] worker 57 stopped. I0417 18:43:18.785498 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 40.710401ms to process 0 records I0417 18:43:18.786257 1 tasks_processing.go:74] worker 38 stopped. I0417 18:43:18.786271 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 40.254176ms to process 0 records W0417 18:43:18.787520 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:43:18.787814 1 tasks_processing.go:74] worker 47 stopped. I0417 18:43:18.788436 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=ff240f73d623a23b3f8dfb229272aff5ee1cbb51a00ff95f5259f3397c0b93f2 I0417 18:43:18.788639 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=eb17c4d1e455645b7dedc319957ea5e843fd65d3ab1b6f6d5308aa3a58b76204 I0417 18:43:18.788648 1 gather.go:177] gatherer "clusterconfig" function "crds" took 43.335147ms to process 2 records I0417 18:43:18.795437 1 tasks_processing.go:74] worker 2 stopped. I0417 18:43:18.795596 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=0d93221e58082d5120e716108f21270bc70f42cf0193eb8328486fd2e65bbec5 I0417 18:43:18.795680 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=27a0dfed889fa788444d5449ff002463488ae98921d0d7ee5686633faae63ca5 I0417 18:43:18.795689 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 52.316479ms to process 2 records I0417 18:43:18.796184 1 tasks_processing.go:74] worker 58 stopped. I0417 18:43:18.796210 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 52.042564ms to process 0 records I0417 18:43:18.796279 1 recorder.go:75] Recording config/olm_operators with fingerprint=4c7d17d61543f8f0bc01bb61084be6241e53dd86c6bd3c85d159303c05b6bc48 I0417 18:43:18.796296 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 51.248209ms to process 1 records I0417 18:43:18.796303 1 tasks_processing.go:74] worker 54 stopped. I0417 18:43:18.796549 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0417 18:43:18.796556 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0417 18:43:18.796647 1 operator.go:288] started I0417 18:43:18.796665 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0417 18:43:18.799583 1 tasks_processing.go:74] worker 53 stopped. I0417 18:43:18.802483 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-zv7tw with fingerprint=46d90342acf46349d1c232626ff4449f8d1254282e9b2b0bf94c3b3a9af48117 I0417 18:43:18.802549 1 recorder.go:75] Recording config/running_containers with fingerprint=7548964a5769b72a31c7d0ee394865b48eb807db303a961522c6f33b8cab2b20 I0417 18:43:18.802559 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 56.636219ms to process 2 records I0417 18:43:18.802568 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 58.218058ms to process 0 records I0417 18:43:18.802574 1 tasks_processing.go:74] worker 10 stopped. I0417 18:43:18.803647 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0417 18:43:18.803659 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0417 18:43:18.803662 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0417 18:43:18.803666 1 controller.go:212] Source scaController *sca.Controller is not ready I0417 18:43:18.803669 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0417 18:43:18.803684 1 controller.go:489] The operator is still being initialized I0417 18:43:18.803691 1 controller.go:512] The operator is healthy I0417 18:43:18.804280 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0417 18:43:18.804563 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0417 18:43:18.804570 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0417 18:43:18.809736 1 prometheus_rules.go:88] Prometheus rules successfully created E0417 18:43:18.811797 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27dbfc0670-4d95-4d8d-bd4b-868f9faba639%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.11:50911->172.30.0.10:53: read: connection refused I0417 18:43:18.811810 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27dbfc0670-4d95-4d8d-bd4b-868f9faba639%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.11:50911->172.30.0.10:53: read: connection refused I0417 18:43:18.812831 1 base_controller.go:82] Caches are synced for ConfigController I0417 18:43:18.812842 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0417 18:43:18.813561 1 tasks_processing.go:74] worker 30 stopped. E0417 18:43:18.813573 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0417 18:43:18.813578 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0417 18:43:18.813581 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0417 18:43:18.813590 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0417 18:43:18.813612 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0417 18:43:18.813619 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0417 18:43:18.813623 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0417 18:43:18.813627 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0417 18:43:18.813678 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0417 18:43:18.813686 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0417 18:43:18.813691 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 70.338296ms to process 7 records I0417 18:43:18.816976 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:43:18.833583 1 tasks_processing.go:74] worker 52 stopped. I0417 18:43:18.833601 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 88.775597ms to process 0 records I0417 18:43:18.834841 1 tasks_processing.go:74] worker 21 stopped. I0417 18:43:18.835119 1 recorder.go:75] Recording config/node/ip-10-0-0-94.ec2.internal with fingerprint=f4de4296d5301ed78cf43a709f8af7fab259695fde0f009ec37b88583942fb32 I0417 18:43:18.835182 1 recorder.go:75] Recording config/node/ip-10-0-1-78.ec2.internal with fingerprint=167d8f1cbff892e7c3476d35a54212501cd1033bd1031a4f82e63ad6663a7744 I0417 18:43:18.835239 1 recorder.go:75] Recording config/node/ip-10-0-2-240.ec2.internal with fingerprint=c18c384f34f19b2129d42a34aabd028817dfaa110d66c751cb40061644b33c5b I0417 18:43:18.835248 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 92.546643ms to process 3 records I0417 18:43:18.835911 1 tasks_processing.go:74] worker 37 stopped. I0417 18:43:18.835930 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0417 18:43:18.835937 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 89.919299ms to process 1 records I0417 18:43:18.843543 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0417 18:43:18.846453 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.11:37268->172.30.0.10:53: read: connection refused I0417 18:43:18.846464 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.11:37268->172.30.0.10:53: read: connection refused I0417 18:43:18.863635 1 tasks_processing.go:74] worker 45 stopped. I0417 18:43:18.863874 1 recorder.go:75] Recording config/version with fingerprint=852636b7948ce09b64ea0c8871b243fdc207350d10bd5a1de5d71ad5036390f4 I0417 18:43:18.863887 1 recorder.go:75] Recording config/id with fingerprint=ffe116933990dfcdf886b1dad048ebc837799d5bbe3fcf5f7a640ae750e24001 I0417 18:43:18.863893 1 gather.go:177] gatherer "clusterconfig" function "version" took 118.596259ms to process 2 records I0417 18:43:18.895762 1 tasks_processing.go:74] worker 23 stopped. E0417 18:43:18.895777 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0417 18:43:18.895783 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2po2qa5ehnr77pr5kio5bcctja6r9653-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2po2qa5ehnr77pr5kio5bcctja6r9653-primary-cert-bundle-secret" not found I0417 18:43:18.895826 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=d7d30711bc6e6504fbc2832490cb1b4a1557ae7f974a96dfc4e48bc6739378d2 I0417 18:43:18.895840 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 151.285899ms to process 1 records I0417 18:43:18.897050 1 base_controller.go:82] Caches are synced for LoggingSyncer I0417 18:43:18.897072 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... W0417 18:43:19.785839 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:43:19.796171 1 tasks_processing.go:74] worker 11 stopped. I0417 18:43:19.796191 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 1.051692355s to process 0 records I0417 18:43:19.993902 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0417 18:43:19.993914 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0417 18:43:19.993943 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-bwxd2 pod in namespace openshift-dns (previous: false). I0417 18:43:20.221231 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bwxd2 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-bwxd2\" is waiting to start: ContainerCreating" I0417 18:43:20.221249 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-bwxd2\" is waiting to start: ContainerCreating" I0417 18:43:20.221260 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-bwxd2 pod in namespace openshift-dns (previous: false). I0417 18:43:20.398559 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bwxd2 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-bwxd2\" is waiting to start: ContainerCreating" I0417 18:43:20.398575 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-bwxd2\" is waiting to start: ContainerCreating" I0417 18:43:20.398589 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-xqlwb pod in namespace openshift-dns (previous: false). I0417 18:43:20.415583 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0417 18:43:20.619677 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xqlwb pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-xqlwb\" is waiting to start: ContainerCreating" I0417 18:43:20.619691 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-xqlwb\" is waiting to start: ContainerCreating" I0417 18:43:20.619701 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-xqlwb pod in namespace openshift-dns (previous: false). W0417 18:43:20.786748 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:43:20.797870 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-xqlwb pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-xqlwb\" is waiting to start: ContainerCreating" I0417 18:43:20.797899 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-xqlwb\" is waiting to start: ContainerCreating" I0417 18:43:20.797908 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-zq95n pod in namespace openshift-dns (previous: false). I0417 18:43:21.017747 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zq95n pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-zq95n\" is waiting to start: ContainerCreating" I0417 18:43:21.017761 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-zq95n\" is waiting to start: ContainerCreating" I0417 18:43:21.017770 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-zq95n pod in namespace openshift-dns (previous: false). I0417 18:43:21.017863 1 tasks_processing.go:74] worker 41 stopped. I0417 18:43:21.017924 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=19b7087298cf51ebfc8c7b05b23f4d00296328120e9c9a1345a053715ee571c6 I0417 18:43:21.017973 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=296ce151b9e85aba1ef21e8a8e51ef21e2ca9da4ab725f673138d5d4673e163d I0417 18:43:21.018018 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0417 18:43:21.018102 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=17bf405e210c8c1bc731e159f37f461806477cee2f580b71956de42fc6d143c4 I0417 18:43:21.018153 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0417 18:43:21.018192 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=f611f0db3994c0e1f0ff327db31c766abb93aba8704528099e5450b8c689182f I0417 18:43:21.018237 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=e523c8c2b3186982cb43ec6be410762570954cf344fd5881425b57530cdc83b7 I0417 18:43:21.018274 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=dcb4275252cac8beca7cd3aa036cc4741b3586aa349a3941dbb1303506af4e64 I0417 18:43:21.018320 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=c3b3d22c04521b614200d6aa44c1f00b475339c0320713328cb2bccf3e353cbb I0417 18:43:21.018336 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I0417 18:43:21.018372 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=c80b98da1d77229948927fe4d6a09ac27f482ff71f4ab0ef885f162196db7559 I0417 18:43:21.018387 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0417 18:43:21.018413 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=3cf89c05cd8fd151b4f13a86c78ac5d18416c06bd07152c00a3dd038fd229830 I0417 18:43:21.018431 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0417 18:43:21.018457 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=2d73e2a4e505420add34acccd83031c46e63c604c8c8d6f645b6ecfadcf89e3c I0417 18:43:21.018474 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0417 18:43:21.018504 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=5e3afec5476f1e0c07e807ba17796f4893717b398b6fa212afba8f37a9bb524e I0417 18:43:21.018522 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0417 18:43:21.018548 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=07925ef2d305a8bf52571012b5792531f209d14c105d7fbb06acce05402c2987 I0417 18:43:21.018684 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=4703acb4f2e9d7e1fe6c00ecbcd2b8e0d09d6b1b5be8026d903f4c0e0def9956 I0417 18:43:21.018709 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0417 18:43:21.018725 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0417 18:43:21.018756 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0417 18:43:21.018791 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=3470c115198fc2de263eb1ecf105c0a6712fdef43e629484e94c931137e7c592 I0417 18:43:21.018826 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=5e6955b608a7635bffadcbcb3b4e38d1e6e80f17a425ea9ece919342007f8e3f I0417 18:43:21.018840 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0417 18:43:21.018868 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=bd7727e000868583ff990191f9393af2c4f8e9e600637995835c79fe6bb4b6fd I0417 18:43:21.018883 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0417 18:43:21.018906 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=127e141e089402ce4336055e008d29d62b9c0c055635144101dd26090f4c50e9 I0417 18:43:21.018931 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=4ae1dc4449c748519b7c80c542381ee4c241f67ac1f205fa2cf71342add82d2c I0417 18:43:21.018958 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=02307b9236a327315d5e5a1fefd068aaf7d1d81bcc59b8893ed65390b98ee18d I0417 18:43:21.018984 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=873676b4dce88ee571f3652276b7036016910ac9e02168712c1a486d55afddbe I0417 18:43:21.019018 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=a15cbe156c2ab86a487f23be9fda6f8a6c30d24623501311d931cd4032ede56d I0417 18:43:21.019033 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0417 18:43:21.019093 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=8f99df571cdbc92c0cdf658d3aa3bc1131f3afd1233c164a95e11646fa2d1ad5 I0417 18:43:21.019121 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0417 18:43:21.019134 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0417 18:43:21.019148 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.273014581s to process 37 records I0417 18:43:21.197829 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zq95n pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-zq95n\" is waiting to start: ContainerCreating" I0417 18:43:21.197841 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-zq95n\" is waiting to start: ContainerCreating" I0417 18:43:21.197851 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-bhkv9 pod in namespace openshift-dns (previous: false). I0417 18:43:21.402338 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:43:21.402355 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-brx69 pod in namespace openshift-dns (previous: false). I0417 18:43:21.602309 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:43:21.602326 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-s9mpx pod in namespace openshift-dns (previous: false). W0417 18:43:21.785900 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:43:21.809207 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:43:21.809268 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-798455c44f-hkl4s pod in namespace openshift-image-registry (previous: false). I0417 18:43:21.999268 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-798455c44f-hkl4s pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-798455c44f-hkl4s\" is waiting to start: ContainerCreating" I0417 18:43:21.999288 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-798455c44f-hkl4s\" is waiting to start: ContainerCreating" I0417 18:43:21.999321 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-798455c44f-xmwnm pod in namespace openshift-image-registry (previous: false). I0417 18:43:22.201645 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-798455c44f-xmwnm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-798455c44f-xmwnm\" is waiting to start: ContainerCreating" I0417 18:43:22.201660 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-798455c44f-xmwnm\" is waiting to start: ContainerCreating" I0417 18:43:22.201706 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-bcf784c7d-mjvjp pod in namespace openshift-image-registry (previous: false). I0417 18:43:22.398766 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-bcf784c7d-mjvjp pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-bcf784c7d-mjvjp\" is waiting to start: ContainerCreating" I0417 18:43:22.398782 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-bcf784c7d-mjvjp\" is waiting to start: ContainerCreating" I0417 18:43:22.398795 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-p6f6d pod in namespace openshift-image-registry (previous: false). I0417 18:43:22.596815 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:43:22.596828 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-thlzv pod in namespace openshift-image-registry (previous: false). W0417 18:43:22.788237 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:43:22.797964 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:43:22.797976 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-wbhtq pod in namespace openshift-image-registry (previous: false). I0417 18:43:22.999325 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:43:22.999338 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-64b6464c47-sqwpj pod in namespace openshift-ingress (previous: false). I0417 18:43:23.199365 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-64b6464c47-sqwpj pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-64b6464c47-sqwpj\" is waiting to start: ContainerCreating" I0417 18:43:23.199379 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-64b6464c47-sqwpj\" is waiting to start: ContainerCreating" I0417 18:43:23.199389 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7f5d446447-7mdxp pod in namespace openshift-ingress (previous: false). I0417 18:43:23.400916 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7f5d446447-7mdxp pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7f5d446447-7mdxp\" is waiting to start: ContainerCreating" I0417 18:43:23.400932 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7f5d446447-7mdxp\" is waiting to start: ContainerCreating" I0417 18:43:23.400941 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7f5d446447-n2pvr pod in namespace openshift-ingress (previous: false). I0417 18:43:23.597648 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7f5d446447-n2pvr pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7f5d446447-n2pvr\" is waiting to start: ContainerCreating" I0417 18:43:23.597662 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7f5d446447-n2pvr\" is waiting to start: ContainerCreating" I0417 18:43:23.597671 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2j5nl pod in namespace openshift-ingress-canary (previous: false). W0417 18:43:23.786508 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0417 18:43:23.786538 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0417 18:43:23.786552 1 tasks_processing.go:74] worker 3 stopped. E0417 18:43:23.786561 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0417 18:43:23.786571 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0417 18:43:23.786586 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0417 18:43:23.786598 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.04207446s to process 1 records I0417 18:43:23.797205 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-2j5nl pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2j5nl\" is waiting to start: ContainerCreating" I0417 18:43:23.797218 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2j5nl\" is waiting to start: ContainerCreating" I0417 18:43:23.797229 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-f8rfj pod in namespace openshift-ingress-canary (previous: false). I0417 18:43:23.999126 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-f8rfj pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-f8rfj\" is waiting to start: ContainerCreating" I0417 18:43:23.999141 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-f8rfj\" is waiting to start: ContainerCreating" I0417 18:43:23.999151 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-njrrj pod in namespace openshift-ingress-canary (previous: false). I0417 18:43:24.196958 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-njrrj pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-njrrj\" is waiting to start: ContainerCreating" I0417 18:43:24.196972 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-njrrj\" is waiting to start: ContainerCreating" I0417 18:43:24.196984 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-7d5f866c57-44wkz pod in namespace openshift-kube-storage-version-migrator (previous: false). I0417 18:43:24.397400 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-7d5f866c57-44wkz pod in namespace openshift-kube-storage-version-migrator (previous: false). I0417 18:43:24.597915 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74848b4cb9-vf88g pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0417 18:43:24.800767 1 tasks_processing.go:74] worker 17 stopped. I0417 18:43:24.800866 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=61021c51afc772b0b3feb459f777c26cfcb2458028adcac6672f1319ad9e6d95 I0417 18:43:24.800919 1 recorder.go:75] Recording events/openshift-dns with fingerprint=6d18a1be6dec1e8c2cc505c49407ec8cf56477f1182ef4d57394530837947f14 I0417 18:43:24.801010 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=3dbe838d347152ef4b9bb7eda34fe876e9964f4393939aa7137b69fc9a78eb2b I0417 18:43:24.801046 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=7cb4b33016b8af05e0b08e9bc0aeb1fab2b6d520de0311d7aebda74679bf1a74 I0417 18:43:24.801111 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=d112644dcbc5bb6e9c0cc96bf033ab8465f38e3d5d22eae94f080bce1d44f8e0 I0417 18:43:24.801129 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=62e29fbbb08981bbee511b8a62f1472b6d57a266517515cb50195271f37aa1f7 I0417 18:43:24.801141 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=92259a28400b12a40b9fb694fbc001356d10d81db192ac24b4bc594833a936d7 I0417 18:43:24.801193 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=347c50fcde730da4845ea42eed9584d8f88bc8d56b3c168584edf93b9f7fa07b I0417 18:43:24.801365 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-798455c44f-hkl4s with fingerprint=d91a88b10ef2748cc9090af8c269aaf6bace13877c6a4a657eb039ef83bb435d I0417 18:43:24.801479 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-798455c44f-xmwnm with fingerprint=6a07abdf174130dd12307d3af772e54b340865991dc301840d1f122ca4bc65f4 I0417 18:43:24.801568 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-bcf784c7d-mjvjp with fingerprint=21ad57099709f81b8fc5984801b7196f76040fbbdf4efc5204f316993fcbac3c I0417 18:43:24.801584 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-44wkz/migrator_current.log with fingerprint=1a95d1deafe415e264f93716a6e1436786d1739b8fa1dd7b0e50c0d126579601 I0417 18:43:24.801588 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-44wkz/graceful-termination_current.log with fingerprint=6aa5b14f298ae3cf62e8213dfcbf1cee2f0d43d70c85d7d2d60a3cb2da13f50f I0417 18:43:24.801662 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74848b4cb9-vf88g/kube-storage-version-migrator-operator_current.log with fingerprint=cfbaaca4bced222c1749630486a37e036d920bb47f5411c22993860f36eb25cc I0417 18:43:24.801672 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.055311938s to process 14 records I0417 18:43:30.460138 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:43:30.658982 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:43:31.225198 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:43:31.595174 1 tasks_processing.go:74] worker 43 stopped. I0417 18:43:31.595211 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0417 18:43:31.595222 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.848860105s to process 1 records I0417 18:43:32.351331 1 tasks_processing.go:74] worker 35 stopped. I0417 18:43:32.351602 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=84ad0e43752ccb8a509dca2afcd9549ee386cc6542bb678120e8c4271861dfb6 I0417 18:43:32.351619 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.606233604s to process 1 records E0417 18:43:32.351672 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.609s with: function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0417 18:43:32.352781 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0417 18:43:32.352796 1 periodic.go:209] Running workloads gatherer I0417 18:43:32.352816 1 tasks_processing.go:45] number of workers: 2 I0417 18:43:32.352828 1 tasks_processing.go:69] worker 1 listening for tasks. I0417 18:43:32.352835 1 tasks_processing.go:71] worker 1 working on workload_info task. I0417 18:43:32.352840 1 tasks_processing.go:69] worker 0 listening for tasks. I0417 18:43:32.352852 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0417 18:43:32.380491 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0417 18:43:32.383285 1 tasks_processing.go:74] worker 0 stopped. I0417 18:43:32.383297 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.419502ms to process 0 records I0417 18:43:32.390387 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (11ms) I0417 18:43:32.400795 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (10ms) I0417 18:43:32.410992 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (10ms) I0417 18:43:32.421415 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (10ms) I0417 18:43:32.431569 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (10ms) I0417 18:43:32.441080 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (9ms) I0417 18:43:32.456046 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (15ms) I0417 18:43:32.466039 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (10ms) I0417 18:43:32.476842 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (11ms) I0417 18:43:32.486719 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (10ms) I0417 18:43:32.496917 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (10ms) I0417 18:43:32.590580 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (94ms) I0417 18:43:32.692861 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (102ms) I0417 18:43:32.790883 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (98ms) I0417 18:43:32.893586 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (103ms) I0417 18:43:32.991891 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (98ms) I0417 18:43:33.090525 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (99ms) I0417 18:43:33.191275 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (101ms) I0417 18:43:33.291588 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0417 18:43:33.390525 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (99ms) I0417 18:43:33.491920 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (101ms) I0417 18:43:33.591326 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (99ms) I0417 18:43:33.692137 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0417 18:43:33.792048 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (100ms) I0417 18:43:33.892523 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0417 18:43:33.992273 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0417 18:43:34.091378 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0417 18:43:34.191623 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0417 18:43:34.291195 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (100ms) I0417 18:43:34.391699 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (100ms) I0417 18:43:34.496620 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (105ms) I0417 18:43:34.591791 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (95ms) I0417 18:43:34.691433 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0417 18:43:34.792332 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (101ms) I0417 18:43:34.792359 1 tasks_processing.go:74] worker 1 stopped. E0417 18:43:34.792370 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0417 18:43:34.792692 1 recorder.go:75] Recording config/workload_info with fingerprint=6392e552350e9b14d7e025115e4946e3865df730f5381a216b268758158d8a13 I0417 18:43:34.792710 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.439516681s to process 1 records E0417 18:43:34.792735 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.439s with: function \"workload_info\" failed with an error" I0417 18:43:34.793834 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0417 18:43:34.793846 1 periodic.go:209] Running conditional gatherer I0417 18:43:34.799805 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0417 18:43:34.806533 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.11:56636->172.30.0.10:53: read: connection refused E0417 18:43:34.806775 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:43:34.806834 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0417 18:43:34.812524 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0417 18:43:34.812538 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:43:34.812543 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:43:34.812546 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:43:34.812549 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:43:34.812552 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:43:34.812575 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:43:34.812581 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:43:34.812585 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:43:34.812588 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0417 18:43:34.812601 1 tasks_processing.go:45] number of workers: 3 I0417 18:43:34.812611 1 tasks_processing.go:69] worker 2 listening for tasks. I0417 18:43:34.812614 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0417 18:43:34.812619 1 tasks_processing.go:69] worker 0 listening for tasks. I0417 18:43:34.812629 1 tasks_processing.go:69] worker 1 listening for tasks. I0417 18:43:34.812637 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0417 18:43:34.812639 1 tasks_processing.go:74] worker 1 stopped. I0417 18:43:34.812633 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0417 18:43:34.812696 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0417 18:43:34.812708 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 742ns to process 1 records I0417 18:43:34.812739 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0417 18:43:34.812748 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.185µs to process 1 records I0417 18:43:34.812766 1 tasks_processing.go:74] worker 0 stopped. I0417 18:43:34.812900 1 tasks_processing.go:74] worker 2 stopped. I0417 18:43:34.812918 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 255.188µs to process 0 records I0417 18:43:34.812947 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.11:56636->172.30.0.10:53: read: connection refused I0417 18:43:34.812965 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0417 18:43:34.835690 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=ce916876183aef56d706ff4e501f8d4526e256491fe00eeed4b491270af842fc I0417 18:43:34.835808 1 diskrecorder.go:70] Writing 111 records to /var/lib/insights-operator/insights-2026-04-17-184334.tar.gz I0417 18:43:34.843106 1 diskrecorder.go:51] Wrote 111 records to disk in 7ms I0417 18:43:34.843132 1 periodic.go:278] Gathering cluster info every 2h0m0s I0417 18:43:34.843146 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0417 18:43:42.304632 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:44:37.408245 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="13ec560cfe080403dcaf7519727d5bb354e705829e96e8efa2fc5c59bcdd8793") W0417 18:44:37.408279 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0417 18:44:37.408324 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="454233e085615903291f3407e5593e7ced9d8f165d2adc7ab1746c0244b8bed0") I0417 18:44:37.408335 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0417 18:44:37.408353 1 base_controller.go:181] Shutting down ConfigController ... I0417 18:44:37.408376 1 periodic.go:170] Shutting down I0417 18:44:37.408386 1 base_controller.go:181] Shutting down LoggingSyncer ... I0417 18:44:37.408399 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0417 18:44:37.408406 1 base_controller.go:113] All ConfigController workers have been terminated I0417 18:44:37.408408 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="b58b22bb0c4a120dcce29a2f5e8aafbe97f4c68d8d972bfcb2c466cc951e0bba") I0417 18:44:37.408414 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0417 18:44:37.408418 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0417 18:44:37.408443 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector