W0427 16:08:13.976306 1 cmd.go:257] Using insecure, self-signed certificates I0427 16:08:14.576448 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0427 16:08:14.576763 1 observer_polling.go:159] Starting file observer I0427 16:08:15.121757 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0427 16:08:15.121952 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0427 16:08:15.122514 1 secure_serving.go:57] Forcing use of http/1.1 only W0427 16:08:15.122535 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0427 16:08:15.122540 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0427 16:08:15.122544 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0427 16:08:15.122547 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0427 16:08:15.122550 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0427 16:08:15.122552 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0427 16:08:15.122569 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0427 16:08:15.126562 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0427 16:08:15.126633 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"85026e95-764f-4f9d-a657-4fb723b51836", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0427 16:08:15.128021 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0427 16:08:15.128033 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0427 16:08:15.128046 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0427 16:08:15.128048 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0427 16:08:15.128071 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0427 16:08:15.128076 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0427 16:08:15.128304 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3222010710/tls.crt::/tmp/serving-cert-3222010710/tls.key" I0427 16:08:15.128549 1 secure_serving.go:213] Serving securely on [::]:8443 I0427 16:08:15.128573 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0427 16:08:15.133273 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0427 16:08:15.133316 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0427 16:08:15.134090 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0427 16:08:15.140180 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0427 16:08:15.140198 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0427 16:08:15.146459 1 secretconfigobserver.go:119] support secret does not exist I0427 16:08:15.151318 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0427 16:08:15.156293 1 secretconfigobserver.go:119] support secret does not exist I0427 16:08:15.159968 1 recorder.go:176] Pruning old reports every 5h33m51s, max age is 288h0m0s I0427 16:08:15.165300 1 periodic.go:216] Running clusterconfig gatherer I0427 16:08:15.165311 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0427 16:08:15.165329 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0427 16:08:15.165335 1 tasks_processing.go:45] number of workers: 64 I0427 16:08:15.165351 1 tasks_processing.go:69] worker 3 listening for tasks. I0427 16:08:15.165356 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0427 16:08:15.165363 1 tasks_processing.go:69] worker 2 listening for tasks. I0427 16:08:15.165364 1 insightsreport.go:296] Starting report retriever I0427 16:08:15.165369 1 tasks_processing.go:69] worker 0 listening for tasks. I0427 16:08:15.165372 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0427 16:08:15.165373 1 tasks_processing.go:69] worker 1 listening for tasks. I0427 16:08:15.165383 1 tasks_processing.go:69] worker 35 listening for tasks. I0427 16:08:15.165384 1 tasks_processing.go:69] worker 34 listening for tasks. I0427 16:08:15.165391 1 tasks_processing.go:69] worker 51 listening for tasks. I0427 16:08:15.165393 1 tasks_processing.go:71] worker 34 working on ceph_cluster task. I0427 16:08:15.165397 1 tasks_processing.go:69] worker 52 listening for tasks. I0427 16:08:15.165394 1 tasks_processing.go:69] worker 50 listening for tasks. I0427 16:08:15.165403 1 tasks_processing.go:69] worker 53 listening for tasks. I0427 16:08:15.165397 1 tasks_processing.go:69] worker 42 listening for tasks. I0427 16:08:15.165403 1 tasks_processing.go:69] worker 39 listening for tasks. I0427 16:08:15.165390 1 tasks_processing.go:71] worker 35 working on cost_management_metrics_configs task. I0427 16:08:15.165412 1 tasks_processing.go:69] worker 43 listening for tasks. I0427 16:08:15.165396 1 tasks_processing.go:69] worker 18 listening for tasks. I0427 16:08:15.165406 1 tasks_processing.go:69] worker 4 listening for tasks. I0427 16:08:15.165410 1 tasks_processing.go:69] worker 40 listening for tasks. I0427 16:08:15.165417 1 tasks_processing.go:69] worker 5 listening for tasks. I0427 16:08:15.165416 1 tasks_processing.go:69] worker 41 listening for tasks. I0427 16:08:15.165422 1 tasks_processing.go:69] worker 38 listening for tasks. I0427 16:08:15.165423 1 tasks_processing.go:69] worker 59 listening for tasks. I0427 16:08:15.165452 1 tasks_processing.go:69] worker 36 listening for tasks. I0427 16:08:15.165446 1 tasks_processing.go:69] worker 54 listening for tasks. I0427 16:08:15.165461 1 tasks_processing.go:69] worker 58 listening for tasks. I0427 16:08:15.165464 1 tasks_processing.go:69] worker 37 listening for tasks. I0427 16:08:15.165446 1 tasks_processing.go:69] worker 6 listening for tasks. I0427 16:08:15.165470 1 tasks_processing.go:69] worker 9 listening for tasks. I0427 16:08:15.165475 1 tasks_processing.go:69] worker 10 listening for tasks. I0427 16:08:15.165470 1 tasks_processing.go:69] worker 56 listening for tasks. I0427 16:08:15.165480 1 tasks_processing.go:69] worker 47 listening for tasks. I0427 16:08:15.165483 1 tasks_processing.go:69] worker 11 listening for tasks. I0427 16:08:15.165487 1 tasks_processing.go:69] worker 14 listening for tasks. I0427 16:08:15.165453 1 tasks_processing.go:69] worker 7 listening for tasks. I0427 16:08:15.165491 1 tasks_processing.go:69] worker 55 listening for tasks. I0427 16:08:15.165486 1 tasks_processing.go:69] worker 32 listening for tasks. I0427 16:08:15.165495 1 tasks_processing.go:69] worker 30 listening for tasks. I0427 16:08:15.165500 1 tasks_processing.go:69] worker 19 listening for tasks. I0427 16:08:15.165500 1 tasks_processing.go:69] worker 15 listening for tasks. I0427 16:08:15.165499 1 tasks_processing.go:69] worker 12 listening for tasks. I0427 16:08:15.165513 1 tasks_processing.go:69] worker 16 listening for tasks. I0427 16:08:15.165461 1 tasks_processing.go:69] worker 8 listening for tasks. I0427 16:08:15.165518 1 tasks_processing.go:69] worker 25 listening for tasks. I0427 16:08:15.165522 1 tasks_processing.go:69] worker 17 listening for tasks. I0427 16:08:15.165516 1 tasks_processing.go:69] worker 24 listening for tasks. I0427 16:08:15.165526 1 tasks_processing.go:71] worker 8 working on pdbs task. I0427 16:08:15.165529 1 tasks_processing.go:69] worker 60 listening for tasks. I0427 16:08:15.165531 1 tasks_processing.go:71] worker 55 working on image task. I0427 16:08:15.165533 1 tasks_processing.go:69] worker 61 listening for tasks. I0427 16:08:15.165535 1 tasks_processing.go:71] worker 42 working on machine_sets task. I0427 16:08:15.165538 1 tasks_processing.go:71] worker 6 working on storage_classes task. I0427 16:08:15.165540 1 tasks_processing.go:71] worker 40 working on machine_configs task. I0427 16:08:15.165543 1 tasks_processing.go:71] worker 5 working on overlapping_namespace_uids task. I0427 16:08:15.165536 1 tasks_processing.go:69] worker 62 listening for tasks. I0427 16:08:15.165550 1 tasks_processing.go:71] worker 30 working on networks task. I0427 16:08:15.165547 1 tasks_processing.go:71] worker 58 working on qemu_kubevirt_launcher_logs task. I0427 16:08:15.165551 1 tasks_processing.go:69] worker 63 listening for tasks. I0427 16:08:15.165552 1 tasks_processing.go:71] worker 53 working on feature_gates task. I0427 16:08:15.165560 1 tasks_processing.go:71] worker 3 working on schedulers task. I0427 16:08:15.165565 1 tasks_processing.go:71] worker 19 working on mutating_webhook_configurations task. I0427 16:08:15.165566 1 tasks_processing.go:71] worker 9 working on support_secret task. I0427 16:08:15.165471 1 tasks_processing.go:69] worker 13 listening for tasks. I0427 16:08:15.165534 1 tasks_processing.go:71] worker 11 working on oauths task. I0427 16:08:15.165377 1 tasks_processing.go:71] worker 2 working on openstack_controlplanes task. I0427 16:08:15.165385 1 tasks_processing.go:71] worker 1 working on sap_pods task. I0427 16:08:15.165535 1 tasks_processing.go:71] worker 4 working on version task. I0427 16:08:15.165713 1 tasks_processing.go:71] worker 13 working on ingress_certificates task. I0427 16:08:15.165724 1 tasks_processing.go:71] worker 60 working on silenced_alerts task. W0427 16:08:15.165745 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0427 16:08:15.165759 1 tasks_processing.go:71] worker 62 working on operators task. I0427 16:08:15.165762 1 tasks_processing.go:71] worker 25 working on jaegers task. I0427 16:08:15.165763 1 tasks_processing.go:71] worker 24 working on proxies task. I0427 16:08:15.165480 1 tasks_processing.go:69] worker 33 listening for tasks. I0427 16:08:15.165474 1 tasks_processing.go:69] worker 46 listening for tasks. I0427 16:08:15.165770 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 32.772µs to process 0 records I0427 16:08:15.165779 1 tasks_processing.go:71] worker 46 working on monitoring_persistent_volumes task. I0427 16:08:15.165491 1 tasks_processing.go:69] worker 48 listening for tasks. I0427 16:08:15.165789 1 tasks_processing.go:71] worker 48 working on pod_network_connectivity_checks task. I0427 16:08:15.165496 1 tasks_processing.go:69] worker 22 listening for tasks. I0427 16:08:15.165456 1 tasks_processing.go:69] worker 57 listening for tasks. I0427 16:08:15.165487 1 tasks_processing.go:69] worker 27 listening for tasks. I0427 16:08:15.165507 1 tasks_processing.go:69] worker 20 listening for tasks. I0427 16:08:15.165506 1 tasks_processing.go:69] worker 49 listening for tasks. I0427 16:08:15.165506 1 tasks_processing.go:69] worker 21 listening for tasks. I0427 16:08:15.165513 1 tasks_processing.go:71] worker 41 working on sap_datahubs task. I0427 16:08:15.165764 1 tasks_processing.go:71] worker 60 working on metrics task. I0427 16:08:15.165517 1 tasks_processing.go:71] worker 15 working on container_images task. W0427 16:08:15.166110 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0427 16:08:15.166170 1 tasks_processing.go:71] worker 60 working on openshift_machine_api_events task. I0427 16:08:15.166194 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 313.577µs to process 0 records I0427 16:08:15.166201 1 tasks_processing.go:71] worker 49 working on clusterroles task. I0427 16:08:15.166236 1 tasks_processing.go:71] worker 57 working on machine_healthchecks task. I0427 16:08:15.166143 1 tasks_processing.go:71] worker 27 working on authentication task. I0427 16:08:15.165520 1 tasks_processing.go:71] worker 38 working on node_logs task. I0427 16:08:15.165517 1 tasks_processing.go:71] worker 12 working on service_accounts task. I0427 16:08:15.166408 1 tasks_processing.go:71] worker 21 working on container_runtime_configs task. I0427 16:08:15.165521 1 tasks_processing.go:71] worker 52 working on machines task. I0427 16:08:15.165461 1 tasks_processing.go:69] worker 45 listening for tasks. I0427 16:08:15.165524 1 tasks_processing.go:71] worker 16 working on openstack_dataplanenodesets task. I0427 16:08:15.166587 1 tasks_processing.go:71] worker 45 working on config_maps task. I0427 16:08:15.165525 1 tasks_processing.go:71] worker 56 working on crds task. I0427 16:08:15.165519 1 tasks_processing.go:69] worker 26 listening for tasks. I0427 16:08:15.165526 1 tasks_processing.go:71] worker 50 working on dvo_metrics task. I0427 16:08:15.165516 1 tasks_processing.go:69] worker 23 listening for tasks. I0427 16:08:15.165530 1 tasks_processing.go:71] worker 47 working on operators_pods_and_events task. I0427 16:08:15.165524 1 tasks_processing.go:71] worker 10 working on validating_webhook_configurations task. I0427 16:08:15.167364 1 tasks_processing.go:71] worker 26 working on nodenetworkconfigurationpolicies task. I0427 16:08:15.165530 1 tasks_processing.go:71] worker 59 working on sap_config task. I0427 16:08:15.165531 1 tasks_processing.go:71] worker 18 working on storage_cluster task. I0427 16:08:15.165534 1 tasks_processing.go:71] worker 36 working on openstack_version task. I0427 16:08:15.165539 1 tasks_processing.go:71] worker 14 working on aggregated_monitoring_cr_names task. I0427 16:08:15.165536 1 tasks_processing.go:71] worker 39 working on ingress task. I0427 16:08:15.165542 1 tasks_processing.go:71] worker 54 working on image_registries task. I0427 16:08:15.165543 1 tasks_processing.go:71] worker 7 working on nodenetworkstates task. I0427 16:08:15.165547 1 tasks_processing.go:71] worker 32 working on image_pruners task. I0427 16:08:15.165375 1 tasks_processing.go:71] worker 0 working on infrastructures task. I0427 16:08:15.165470 1 tasks_processing.go:69] worker 31 listening for tasks. I0427 16:08:15.165478 1 tasks_processing.go:69] worker 28 listening for tasks. I0427 16:08:15.165753 1 tasks_processing.go:71] worker 61 working on tsdb_status task. I0427 16:08:15.168014 1 tasks_processing.go:71] worker 31 working on machine_config_pools task. I0427 16:08:15.165758 1 tasks_processing.go:71] worker 17 working on nodes task. I0427 16:08:15.165757 1 tasks_processing.go:71] worker 63 working on install_plans task. I0427 16:08:15.165453 1 tasks_processing.go:69] worker 44 listening for tasks. I0427 16:08:15.165774 1 tasks_processing.go:71] worker 33 working on lokistack task. I0427 16:08:15.165487 1 tasks_processing.go:69] worker 29 listening for tasks. I0427 16:08:15.165517 1 tasks_processing.go:71] worker 51 working on certificate_signing_requests task. I0427 16:08:15.166183 1 tasks_processing.go:71] worker 20 working on openstack_dataplanedeployments task. I0427 16:08:15.166212 1 tasks_processing.go:71] worker 22 working on olm_operators task. I0427 16:08:15.167281 1 tasks_processing.go:71] worker 23 working on active_alerts task. W0427 16:08:15.168235 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0427 16:08:15.168256 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 26.41µs to process 0 records I0427 16:08:15.165530 1 tasks_processing.go:71] worker 43 working on machine_autoscalers task. I0427 16:08:15.165538 1 tasks_processing.go:71] worker 37 working on cluster_apiserver task. I0427 16:08:15.168250 1 tasks_processing.go:74] worker 23 stopped. I0427 16:08:15.168941 1 tasks_processing.go:71] worker 28 working on node_features task. W0427 16:08:15.169038 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0427 16:08:15.169051 1 tasks_processing.go:74] worker 61 stopped. I0427 16:08:15.169058 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.037605ms to process 0 records I0427 16:08:15.169158 1 tasks_processing.go:71] worker 44 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0427 16:08:15.169185 1 tasks_processing.go:71] worker 29 working on openshift_logging task. I0427 16:08:15.169630 1 tasks_processing.go:74] worker 34 stopped. I0427 16:08:15.169642 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 4.228894ms to process 0 records I0427 16:08:15.170537 1 tasks_processing.go:74] worker 35 stopped. I0427 16:08:15.170550 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.119121ms to process 0 records I0427 16:08:15.170716 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0427 16:08:15.170733 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0427 16:08:15.170737 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0427 16:08:15.170739 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0427 16:08:15.170754 1 controller.go:531] The operator is still being initialized I0427 16:08:15.170761 1 controller.go:554] The operator is healthy I0427 16:08:15.173342 1 tasks_processing.go:74] worker 55 stopped. I0427 16:08:15.173454 1 recorder.go:75] Recording config/image with fingerprint=3d8a5d8939cbb8649de26696f67fc0f72f30c76d18340adf96c1cf5924535e98 I0427 16:08:15.173467 1 gather.go:177] gatherer "clusterconfig" function "image" took 7.797408ms to process 1 records I0427 16:08:15.176705 1 tasks_processing.go:74] worker 2 stopped. I0427 16:08:15.176720 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 11.042362ms to process 0 records I0427 16:08:15.176804 1 tasks_processing.go:74] worker 16 stopped. I0427 16:08:15.176812 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 10.270093ms to process 0 records I0427 16:08:15.176823 1 tasks_processing.go:74] worker 21 stopped. I0427 16:08:15.176827 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 10.397836ms to process 0 records I0427 16:08:15.176888 1 tasks_processing.go:74] worker 8 stopped. I0427 16:08:15.177018 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=1391b09c5ffa704cacc19208ad6d6dbc932833beb1f727899211fb3b9357ab03 I0427 16:08:15.177044 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=b3d36b7bb5f5abfe56f1ffef2fec9b46a5d170671a30efc56c9ab904d0da4066 I0427 16:08:15.177067 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=26dc222174ade01b8618009deede8808fd82d6e4c0dd0c4f7408ff4c719f471a I0427 16:08:15.177076 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 11.350906ms to process 3 records E0427 16:08:15.177086 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0427 16:08:15.177093 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 10.69563ms to process 0 records I0427 16:08:15.177125 1 tasks_processing.go:74] worker 57 stopped. I0427 16:08:15.177207 1 tasks_processing.go:74] worker 11 stopped. I0427 16:08:15.177307 1 recorder.go:75] Recording config/oauth with fingerprint=ed4b12ccded5787a89808befd4c54515020f97e92f2d31b8c2b636ad8f5f3f6b I0427 16:08:15.177316 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 11.395672ms to process 1 records I0427 16:08:15.177394 1 tasks_processing.go:74] worker 30 stopped. I0427 16:08:15.177472 1 recorder.go:75] Recording config/network with fingerprint=3e818ada80be1f0e8279488394607851510fecd9df82c7219912c4c67e713677 I0427 16:08:15.177483 1 gather.go:177] gatherer "clusterconfig" function "networks" took 11.56372ms to process 1 records I0427 16:08:15.177558 1 tasks_processing.go:74] worker 53 stopped. I0427 16:08:15.177573 1 recorder.go:75] Recording config/featuregate with fingerprint=bd76ab1fbeacfe6c3a0c741cd9b609440287ba22c829b9fcd3a395f301aaef95 I0427 16:08:15.177582 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 11.635955ms to process 1 records I0427 16:08:15.181680 1 tasks_processing.go:74] worker 48 stopped. E0427 16:08:15.181691 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0427 16:08:15.181698 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 15.882911ms to process 0 records I0427 16:08:15.181704 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 15.971959ms to process 0 records I0427 16:08:15.181708 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 15.918432ms to process 0 records I0427 16:08:15.181713 1 tasks_processing.go:74] worker 25 stopped. I0427 16:08:15.181716 1 tasks_processing.go:74] worker 1 stopped. I0427 16:08:15.181721 1 tasks_processing.go:74] worker 9 stopped. E0427 16:08:15.181727 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0427 16:08:15.181733 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 16.141643ms to process 0 records I0427 16:08:15.181832 1 tasks_processing.go:74] worker 6 stopped. I0427 16:08:15.181835 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=e1f0e7d95d4d5c14c8fafac551718d84566b52d720e374b400453ac84595c55f I0427 16:08:15.181869 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=e50d863cce8db306b7038e8e3c1f13e8d16fec9f86aac6920c39d32691c8bb16 I0427 16:08:15.181885 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 16.180506ms to process 2 records I0427 16:08:15.181892 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 14.471762ms to process 0 records I0427 16:08:15.181896 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 15.681831ms to process 0 records I0427 16:08:15.181914 1 tasks_processing.go:74] worker 26 stopped. I0427 16:08:15.181926 1 tasks_processing.go:74] worker 60 stopped. I0427 16:08:15.181949 1 recorder.go:75] Recording config/proxy with fingerprint=aafba4ae1f4a48ff4c5a0d22bdd49ca52acab0968d996cc0cd88b9624c14e183 I0427 16:08:15.181957 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 16.100023ms to process 1 records I0427 16:08:15.181962 1 tasks_processing.go:74] worker 24 stopped. I0427 16:08:15.182044 1 tasks_processing.go:74] worker 27 stopped. I0427 16:08:15.182185 1 recorder.go:75] Recording config/authentication with fingerprint=280a807cbb61396e5d59228fb7beacd2c29e67576b3ccb5e6bbe032028ea239d I0427 16:08:15.182196 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 15.730327ms to process 1 records I0427 16:08:15.188530 1 tasks_processing.go:74] worker 42 stopped. I0427 16:08:15.188539 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 22.986863ms to process 0 records I0427 16:08:15.188546 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 22.713779ms to process 0 records I0427 16:08:15.188550 1 tasks_processing.go:74] worker 41 stopped. I0427 16:08:15.188556 1 tasks_processing.go:74] worker 52 stopped. E0427 16:08:15.188563 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0427 16:08:15.188569 1 gather.go:177] gatherer "clusterconfig" function "machines" took 22.036034ms to process 0 records I0427 16:08:15.191699 1 tasks_processing.go:74] worker 18 stopped. I0427 16:08:15.191709 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 24.133765ms to process 0 records I0427 16:08:15.191716 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 24.05934ms to process 0 records I0427 16:08:15.191720 1 tasks_processing.go:74] worker 36 stopped. I0427 16:08:15.191731 1 tasks_processing.go:74] worker 59 stopped. I0427 16:08:15.191740 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 24.325061ms to process 0 records I0427 16:08:15.192219 1 tasks_processing.go:74] worker 40 stopped. E0427 16:08:15.192227 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0427 16:08:15.192246 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0427 16:08:15.192258 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 26.67148ms to process 1 records E0427 16:08:15.193476 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0427 16:08:15.193489 1 tasks_processing.go:74] worker 28 stopped. I0427 16:08:15.193498 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 24.533067ms to process 0 records I0427 16:08:15.193516 1 tasks_processing.go:74] worker 31 stopped. I0427 16:08:15.193526 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 25.489228ms to process 0 records I0427 16:08:15.193534 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 25.456475ms to process 0 records I0427 16:08:15.193540 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 25.259128ms to process 0 records I0427 16:08:15.193543 1 tasks_processing.go:74] worker 33 stopped. I0427 16:08:15.193546 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 25.620983ms to process 0 records I0427 16:08:15.193551 1 tasks_processing.go:74] worker 7 stopped. I0427 16:08:15.193556 1 tasks_processing.go:74] worker 43 stopped. I0427 16:08:15.193710 1 tasks_processing.go:74] worker 3 stopped. I0427 16:08:15.193768 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=5c0fdfbd32df66c5808958974188305b7862f53b3e03882558b126b7dfb3d223 I0427 16:08:15.193778 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 28.13591ms to process 1 records I0427 16:08:15.193867 1 tasks_processing.go:74] worker 32 stopped. I0427 16:08:15.194036 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=957966795244250818d82e1fdb80c38e0bf871b707350813b628379a4c594711 I0427 16:08:15.194044 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 25.887888ms to process 1 records I0427 16:08:15.198067 1 tasks_processing.go:74] worker 0 stopped. I0427 16:08:15.198544 1 recorder.go:75] Recording config/infrastructure with fingerprint=a171962c1b160f7086f5d7e71c42f1c23bdb18bfdea9207f86980cf20f921c5a I0427 16:08:15.198564 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 30.07932ms to process 1 records I0427 16:08:15.198653 1 tasks_processing.go:74] worker 39 stopped. I0427 16:08:15.198682 1 recorder.go:75] Recording config/ingress with fingerprint=1f6f8836251ca57e578ff45ef13fb3bfc28c2e01dddde961bb0b681d2df815ea I0427 16:08:15.198691 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 30.378384ms to process 1 records I0427 16:08:15.202600 1 gather_logs.go:145] no pods in namespace were found I0427 16:08:15.202613 1 tasks_processing.go:74] worker 58 stopped. I0427 16:08:15.202621 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 37.053634ms to process 0 records I0427 16:08:15.202634 1 tasks_processing.go:74] worker 46 stopped. I0427 16:08:15.202647 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 36.843555ms to process 0 records W0427 16:08:15.202919 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0427 16:08:15.202919 1 tasks_processing.go:74] worker 37 stopped. I0427 16:08:15.203109 1 recorder.go:75] Recording config/apiserver with fingerprint=d124ac4da8a84109c43f5d6502f7d85ade37ef8680fcabb6844360ae566b1d4a I0427 16:08:15.203128 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 34.640002ms to process 1 records I0427 16:08:15.203198 1 tasks_processing.go:74] worker 29 stopped. I0427 16:08:15.203210 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 34.003261ms to process 0 records I0427 16:08:15.203707 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0427 16:08:15.203718 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0427 16:08:15.203832 1 operator.go:328] started I0427 16:08:15.203853 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0427 16:08:15.203893 1 tasks_processing.go:74] worker 20 stopped. I0427 16:08:15.203905 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 35.790185ms to process 0 records I0427 16:08:15.203935 1 tasks_processing.go:74] worker 38 stopped. I0427 16:08:15.203940 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 37.614236ms to process 0 records I0427 16:08:15.204223 1 tasks_processing.go:74] worker 49 stopped. I0427 16:08:15.204449 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=c5bbad31c7c593f8a6d66ed190b694179e1bd8bc0df640e6daed238b7a471389 I0427 16:08:15.204536 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=839d5c0a87f2ce1b45aa2326af80207a5f916346f8960ae655983763628cf40e I0427 16:08:15.204545 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 37.970077ms to process 2 records I0427 16:08:15.204626 1 tasks_processing.go:74] worker 19 stopped. I0427 16:08:15.204671 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7de771c2c001d8df0373f209aa078e55647ecc14a7031edadb87f72184b386b4 I0427 16:08:15.204704 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=662a3e1b7c972ef1bfc3bc1f8bbab5e00b3e1539711fc4d9e9c6aeb75a0051e3 I0427 16:08:15.204734 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=76947f0b5dc8734f4353eec3dc5cff314dc7ec3aea0ceb2ba57a5556d51b0a86 I0427 16:08:15.204741 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 38.709967ms to process 3 records I0427 16:08:15.204903 1 tasks_processing.go:74] worker 54 stopped. I0427 16:08:15.205039 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=6c3f5356aa680e8ad7bf814aa0274e5416130cd9391a0d7dca7cd193e04fbb08 I0427 16:08:15.205047 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 36.709017ms to process 1 records I0427 16:08:15.205055 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 36.851177ms to process 0 records I0427 16:08:15.205060 1 tasks_processing.go:74] worker 22 stopped. I0427 16:08:15.205623 1 tasks_processing.go:74] worker 10 stopped. I0427 16:08:15.205993 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=20899887bf54b292639ffbb0db7be97b5d90537c9bd9f17a21326e3dbc691f76 I0427 16:08:15.206173 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=fb38b3f51656d4cf7a273af00451b69df05e39f43008626296571541adadaa29 I0427 16:08:15.206247 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=093fb2a6bcdc66fab2d7e9b658948be6bee93c86ae2f6e781ccc0de1bf0bd8ca I0427 16:08:15.206319 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=4a7f05b38807a10d2c8834a7fc90d48fd64ac250133d07668fbe955574bdd25c I0427 16:08:15.206475 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=49f0fabd2a2ea7e2e930d68537ed69e08f47c116e06cbb6a07cdc4f01bae5aa5 I0427 16:08:15.206571 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ca1213d3c93221db31d2217605012f36661dadab6ef26d469b68cd1449e117d1 I0427 16:08:15.206675 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=7f964cc2f6b76cba479809ca94f57593f30dd892dad37d7c12296be8d4ada6e9 I0427 16:08:15.206778 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=35b0fc19755f2251d3478ddda448a2be952f6e32bb3c6e20b15992c8db0e310d I0427 16:08:15.206868 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=22c3aca1a600291d918f5e03478c42f7451ad4e8a9cffb7d38d9f2f92d95f042 I0427 16:08:15.206934 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=c5ee5b994fdead95a8e15c4799c3db5224d2194ce75feb23eed52ea76f453c98 I0427 16:08:15.207010 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=1508da4edf871ebbe6ef6ed395087069012f3d566c3c9544e16a5d7ff155ce1d I0427 16:08:15.207038 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 38.297533ms to process 11 records I0427 16:08:15.207149 1 tasks_processing.go:74] worker 5 stopped. I0427 16:08:15.207221 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0427 16:08:15.207255 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 41.593224ms to process 1 records I0427 16:08:15.209328 1 tasks_processing.go:74] worker 51 stopped. I0427 16:08:15.209344 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 41.22747ms to process 0 records I0427 16:08:15.211222 1 tasks_processing.go:74] worker 56 stopped. I0427 16:08:15.211718 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=5eebe5630cadf8193fa8693aedd2b60846a81b82d84864e5fda270bbe61cc4b5 I0427 16:08:15.211927 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=23cca25bbf3c586054a1a1dd149e12254471f0fcde2e70ae0ae7daf12ec954d8 I0427 16:08:15.211937 1 gather.go:177] gatherer "clusterconfig" function "crds" took 44.300145ms to process 2 records I0427 16:08:15.219442 1 prometheus_rules.go:88] Prometheus rules successfully created I0427 16:08:15.219678 1 controller.go:254] Source scaController *sca.Controller is not ready I0427 16:08:15.219691 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0427 16:08:15.219695 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0427 16:08:15.219698 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0427 16:08:15.219701 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0427 16:08:15.219718 1 controller.go:531] The operator is still being initialized I0427 16:08:15.219723 1 controller.go:554] The operator is healthy I0427 16:08:15.224770 1 tasks_processing.go:74] worker 15 stopped. I0427 16:08:15.226289 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-2bz8n with fingerprint=3c402f571e928225fd35d2b945b187d12e83500775a8f3d83f82f594afa1a94e I0427 16:08:15.226342 1 recorder.go:75] Recording config/running_containers with fingerprint=8262a32a453725acb8e249b82cf9a16255a3cbb51664f121cadb1800211fa27f I0427 16:08:15.226351 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 58.725792ms to process 2 records I0427 16:08:15.227553 1 tasks_processing.go:74] worker 14 stopped. I0427 16:08:15.227569 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 59.805161ms to process 0 records E0427 16:08:15.227662 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2731e3476b-a0f6-4466-8a0d-77fec3de0900%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.12:44371->172.30.0.10:53: read: connection refused I0427 16:08:15.227672 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2731e3476b-a0f6-4466-8a0d-77fec3de0900%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.12:44371->172.30.0.10:53: read: connection refused I0427 16:08:15.228692 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0427 16:08:15.228702 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0427 16:08:15.228708 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0427 16:08:15.231824 1 tasks_processing.go:74] worker 45 stopped. E0427 16:08:15.231840 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0427 16:08:15.231846 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0427 16:08:15.231850 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0427 16:08:15.231858 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0427 16:08:15.231894 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0427 16:08:15.231901 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0427 16:08:15.231906 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0427 16:08:15.231912 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0427 16:08:15.231958 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0427 16:08:15.231967 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0427 16:08:15.231972 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 65.181051ms to process 7 records I0427 16:08:15.234472 1 base_controller.go:82] Caches are synced for ConfigController I0427 16:08:15.234483 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0427 16:08:15.234509 1 tasks_processing.go:74] worker 13 stopped. E0427 16:08:15.234526 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0427 16:08:15.234534 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pujfmu759k20adih9hq5ubv69ba1hlj-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pujfmu759k20adih9hq5ubv69ba1hlj-primary-cert-bundle-secret" not found I0427 16:08:15.234589 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=1675c68c05b4d19a3c4d424708467b665eedd886520b3388b4b92de0533d65f8 I0427 16:08:15.234605 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 68.786036ms to process 1 records I0427 16:08:15.239396 1 configmapobserver.go:84] configmaps "insights-config" not found I0427 16:08:15.286118 1 tasks_processing.go:74] worker 17 stopped. I0427 16:08:15.286487 1 recorder.go:75] Recording config/node/ip-10-0-0-119.ec2.internal with fingerprint=efe09f65d0c8e42287b6b1f106c38c4e2758e1c90ba332fb338db64b950e1660 I0427 16:08:15.286545 1 recorder.go:75] Recording config/node/ip-10-0-1-57.ec2.internal with fingerprint=905f8fa8a2e8593aa321d821c24a3ba8dc54c83526b9f4808445c5a3e125d92e I0427 16:08:15.286596 1 recorder.go:75] Recording config/node/ip-10-0-2-167.ec2.internal with fingerprint=a5e4e60169368bf7e236a8ec5f48e0b1b87ff9422dfc89d19d08e17232c8c1e8 I0427 16:08:15.286605 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 118.062851ms to process 3 records I0427 16:08:15.289791 1 tasks_processing.go:74] worker 4 stopped. I0427 16:08:15.290039 1 recorder.go:75] Recording config/version with fingerprint=488113e9c98add9c0fda478d1ed1c0dfd4598f007d7677ef8688d0fd2141e550 I0427 16:08:15.290052 1 recorder.go:75] Recording config/id with fingerprint=a606add76ed2ba5ae518d4d75089b3e508ecf34c0a67465d925f84987f382a6f I0427 16:08:15.290059 1 gather.go:177] gatherer "clusterconfig" function "version" took 124.068219ms to process 2 records I0427 16:08:15.295404 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0427 16:08:15.299129 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.12:56780->172.30.0.10:53: read: connection refused I0427 16:08:15.299144 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.12:56780->172.30.0.10:53: read: connection refused I0427 16:08:15.304466 1 base_controller.go:82] Caches are synced for LoggingSyncer I0427 16:08:15.304481 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0427 16:08:15.306993 1 tasks_processing.go:74] worker 44 stopped. I0427 16:08:15.307007 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 137.816817ms to process 0 records W0427 16:08:16.202653 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0427 16:08:16.415959 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0427 16:08:16.415973 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0427 16:08:16.416138 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-7b5lq pod in namespace openshift-dns (previous: false). I0427 16:08:16.620735 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7b5lq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-7b5lq\" is waiting to start: ContainerCreating" I0427 16:08:16.620752 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-7b5lq\" is waiting to start: ContainerCreating" I0427 16:08:16.620761 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-7b5lq pod in namespace openshift-dns (previous: false). I0427 16:08:16.628378 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0427 16:08:16.819659 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7b5lq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-7b5lq\" is waiting to start: ContainerCreating" I0427 16:08:16.819677 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-7b5lq\" is waiting to start: ContainerCreating" I0427 16:08:16.819689 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-lx42h pod in namespace openshift-dns (previous: false). I0427 16:08:17.048421 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lx42h pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-lx42h\" is waiting to start: ContainerCreating" I0427 16:08:17.048456 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-lx42h\" is waiting to start: ContainerCreating" I0427 16:08:17.048465 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-lx42h pod in namespace openshift-dns (previous: false). W0427 16:08:17.201785 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0427 16:08:17.222379 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lx42h pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-lx42h\" is waiting to start: ContainerCreating" I0427 16:08:17.222396 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-lx42h\" is waiting to start: ContainerCreating" I0427 16:08:17.222409 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-p9dgp pod in namespace openshift-dns (previous: false). I0427 16:08:17.233856 1 tasks_processing.go:74] worker 62 stopped. I0427 16:08:17.233905 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=4fcdd4bfb8262a44ff96cf050292a66d7fa86278f3bad5ca9ebaf8e2f9f811d4 I0427 16:08:17.233956 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=296fba15b5b5dceea5ff61bc983fc24ed5ff73c11d998b86ae4d5887cc3a1f4b I0427 16:08:17.233988 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0427 16:08:17.234015 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=1e3bf8fa10111b1c95eeae572b3775cb02d56568cf0f5c360c40d4c05c7d6cad I0427 16:08:17.234032 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0427 16:08:17.234068 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=af7b75b1f4a40a9f1df290d42e28e142ac01a8d95221cf50d9e63e29dd74ced9 I0427 16:08:17.234098 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=d53a0c6b37ac82862682295ea4a77d322f65d6a93ba242f22cd3eeb2897d09d5 I0427 16:08:17.234122 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=be06c655c7abed09fa8a3e3e43d85093edd6e691b5512ed95b99fe8e3fa6a577 I0427 16:08:17.234137 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=3001ec5c03fc7640b7292856cc1a0b621ac4b310558508d1155cd775293de518 I0427 16:08:17.234153 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=5a0041bc28f9f2f33ab6631cdccd6dce6a04baa110aef0a0581d506b1c45e37f I0427 16:08:17.234162 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0427 16:08:17.234177 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=e439b396ee6eb05e15bdba3b7e4c4e928cdb681c0b3bf0e2e92ebc63d14b7e71 I0427 16:08:17.234188 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0427 16:08:17.234204 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=043326acffa6962fbc4dadddb1d9a3574792b50ff74071537c9c18523cffbd6d I0427 16:08:17.234213 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0427 16:08:17.234235 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=1de2f0ccd90b9b942bcc370e90b2a2d978e868043fece773940bc3248f94d8ad I0427 16:08:17.234245 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0427 16:08:17.234260 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=612c08ccfdae0edb09f452cf8ef3327f2e95ce09a3b52b504ae0e8e3cf4513c9 I0427 16:08:17.234653 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=24e5f390ffa870ad8f17f8eb267ff693b3f58f6d9fd4ca3fc3f41e3cd2f90f85 I0427 16:08:17.234707 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0427 16:08:17.234722 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0427 16:08:17.234791 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0427 16:08:17.234850 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=74d6332c479590dabee61cf41a4c23fd86dcae92e749049ed79fc435b2c819dc I0427 16:08:17.234889 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=93156d0e075ae942fded16d5e5138d6fbb4511cd5217998e023e947723a7e346 I0427 16:08:17.234914 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0427 16:08:17.234944 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=e53984a007df813a7fd42e8c749c587237d8d9e05046fe80e8bacb1779ba5b19 I0427 16:08:17.234959 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0427 16:08:17.234989 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=c30af1ddd3397673f2c6d8e9924a05521775cdea8cda7d674b97775ad544ba45 I0427 16:08:17.235012 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=9639e0574fefe545945ba10352bd72f64e0cd0b543e1fa7ab3810faf5a8744bf I0427 16:08:17.235036 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=89bc904521d5535b7495fe13dc566b52adea090c4e37c44e2fa93a819520fcb2 I0427 16:08:17.235067 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=dc88d14d113a5bb04b9462e8f49b723163b6e6ac0c9649e434591a57314836d1 I0427 16:08:17.235101 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=68f542cee79f02a24cd3be659f45c50523bf9122b91c8be1945c0e51fbae4431 I0427 16:08:17.235115 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0427 16:08:17.235159 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=e009a668ef205b86c9d471b09bc29de2e925e6b0c816c7846426b7a65e498fd3 I0427 16:08:17.235186 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0427 16:08:17.235205 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0427 16:08:17.235216 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.068078902s to process 36 records I0427 16:08:17.445808 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-p9dgp pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-p9dgp\" is waiting to start: ContainerCreating" I0427 16:08:17.445831 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-p9dgp\" is waiting to start: ContainerCreating" I0427 16:08:17.445840 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-p9dgp pod in namespace openshift-dns (previous: false). I0427 16:08:17.623514 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-p9dgp pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-p9dgp\" is waiting to start: ContainerCreating" I0427 16:08:17.623531 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-p9dgp\" is waiting to start: ContainerCreating" I0427 16:08:17.623542 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-2zqrz pod in namespace openshift-dns (previous: false). I0427 16:08:17.828295 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0427 16:08:17.828312 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-cbdb2 pod in namespace openshift-dns (previous: false). I0427 16:08:18.024286 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0427 16:08:18.024306 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ws6dd pod in namespace openshift-dns (previous: false). W0427 16:08:18.201527 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0427 16:08:18.220810 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0427 16:08:18.220863 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-54b8f7bb8b-nnvtq pod in namespace openshift-image-registry (previous: false). I0427 16:08:18.419793 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-54b8f7bb8b-nnvtq pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-54b8f7bb8b-nnvtq\" is waiting to start: ContainerCreating" I0427 16:08:18.419812 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-54b8f7bb8b-nnvtq\" is waiting to start: ContainerCreating" I0427 16:08:18.419861 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-58b67fcf4f-56wgt pod in namespace openshift-image-registry (previous: false). I0427 16:08:18.621945 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-58b67fcf4f-56wgt pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-58b67fcf4f-56wgt\" is waiting to start: ContainerCreating" I0427 16:08:18.621961 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-58b67fcf4f-56wgt\" is waiting to start: ContainerCreating" I0427 16:08:18.621991 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-58b67fcf4f-mpbxf pod in namespace openshift-image-registry (previous: false). I0427 16:08:18.819887 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-58b67fcf4f-mpbxf pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-58b67fcf4f-mpbxf\" is waiting to start: ContainerCreating" I0427 16:08:18.819904 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-58b67fcf4f-mpbxf\" is waiting to start: ContainerCreating" I0427 16:08:18.819915 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-ggqjh pod in namespace openshift-image-registry (previous: false). I0427 16:08:19.021102 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0427 16:08:19.021124 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-jxwjf pod in namespace openshift-image-registry (previous: false). W0427 16:08:19.202262 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0427 16:08:19.220086 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0427 16:08:19.220100 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-x9rvw pod in namespace openshift-image-registry (previous: false). I0427 16:08:19.421140 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0427 16:08:19.421156 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-688887d9cc-brph8 pod in namespace openshift-ingress (previous: false). I0427 16:08:19.619532 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-688887d9cc-brph8 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-688887d9cc-brph8\" is waiting to start: ContainerCreating" I0427 16:08:19.619548 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-688887d9cc-brph8\" is waiting to start: ContainerCreating" I0427 16:08:19.619560 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-688887d9cc-j7z45 pod in namespace openshift-ingress (previous: false). I0427 16:08:19.821933 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-688887d9cc-j7z45 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-688887d9cc-j7z45\" is waiting to start: ContainerCreating" I0427 16:08:19.821954 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-688887d9cc-j7z45\" is waiting to start: ContainerCreating" I0427 16:08:19.821965 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-c4898897-7g66z pod in namespace openshift-ingress (previous: false). I0427 16:08:20.021135 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-c4898897-7g66z pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-c4898897-7g66z\" is waiting to start: ContainerCreating" I0427 16:08:20.021151 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-c4898897-7g66z\" is waiting to start: ContainerCreating" I0427 16:08:20.021162 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-758s7 pod in namespace openshift-ingress-canary (previous: false). W0427 16:08:20.198896 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0427 16:08:20.198920 1 tasks_processing.go:74] worker 50 stopped. E0427 16:08:20.198931 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0427 16:08:20.198942 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0427 16:08:20.198956 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0427 16:08:20.198966 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.031924371s to process 1 records I0427 16:08:20.222009 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-z4ps5 pod in namespace openshift-ingress-canary (previous: false). I0427 16:08:20.428639 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-zd8v2 pod in namespace openshift-ingress-canary (previous: false). I0427 16:08:20.621745 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-wpr27 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0427 16:08:20.852714 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-wpr27 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0427 16:08:21.058550 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-mjbjw pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0427 16:08:21.234677 1 tasks_processing.go:74] worker 47 stopped. I0427 16:08:21.234784 1 recorder.go:75] Recording events/openshift-dns with fingerprint=5785839a1a00574e9d640a3613609c559dcacc885d36603ef309db83a705bf98 I0427 16:08:21.234878 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=8d87e682dcd56dd6487f96ee4543e829eeec017f723f2308a726a06ece1caf8c I0427 16:08:21.234907 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=da5f5cbeebfb86d3095ca47a2a462239fd217624e0dd40c9d3c172e7a5e1c00e I0427 16:08:21.234951 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=7cbc9a2ca17c60c5d06792a5f890abcaf1b01f51554cc64a4a0cc17701127658 I0427 16:08:21.234989 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=937940d40d023be7a0eebe00807143970fd07f18c2cccbc71bf267fd1635e198 I0427 16:08:21.235005 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=952b2e26c2920005465028c9737644b374f4919984a3373800118d8ee075b42b I0427 16:08:21.235055 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=717c32498df6c9c7222c0e2e5b124b8be8ce59eaa55b3ceac21c78c8050e6bf6 I0427 16:08:21.235206 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-54b8f7bb8b-nnvtq with fingerprint=c8a3d287cb46cb8ea9fa7a15e849285e9d8751e303d1e8df19865f06ecf5ff6a I0427 16:08:21.235308 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-58b67fcf4f-56wgt with fingerprint=0be8685c63d1339642b4f494d8ead12de8bf8921b7ed11e2c851689eac0a1ea7 I0427 16:08:21.235395 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-58b67fcf4f-mpbxf with fingerprint=1cd6cb75ccc0cf3e81228fa4d3e27bb2a0448fd3e2be3e9c5fc7a1057bfb33a4 I0427 16:08:21.235402 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-758s7/serve-healthcheck-canary_current.log with fingerprint=4b29bf7bf725fecd4136eb129d53641a5ee912cd11888122ce5b121a75e2ba32 I0427 16:08:21.235408 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-z4ps5/serve-healthcheck-canary_current.log with fingerprint=fe1f034a424fda78fb3f6069c37131c0b154599694e89ab3c2771c83677b2842 I0427 16:08:21.235411 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-zd8v2/serve-healthcheck-canary_current.log with fingerprint=2e966daab9a9114f8876eda34d60872a71da46269d1a43d626a3c07fe0beee74 I0427 16:08:21.235424 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-wpr27/migrator_current.log with fingerprint=f127790653b56f5aa532701dd967f2ed34d1f31c14b640894927a4cfcfc80666 I0427 16:08:21.235451 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-wpr27/graceful-termination_current.log with fingerprint=ed1c90088031a4795a0a94b4ba304105752a2d99ec8229cecda6e476892f32f8 I0427 16:08:21.235531 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-mjbjw/kube-storage-version-migrator-operator_current.log with fingerprint=189d94bb03eacf4dd9901052dd05f7c6cc9d9086a0886be83d7925ef2792dae5 I0427 16:08:21.235540 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.067573786s to process 16 records I0427 16:08:27.756228 1 configmapobserver.go:84] configmaps "insights-config" not found I0427 16:08:27.814366 1 tasks_processing.go:74] worker 63 stopped. I0427 16:08:27.814405 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0427 16:08:27.814419 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.646303753s to process 1 records I0427 16:08:28.576681 1 tasks_processing.go:74] worker 12 stopped. I0427 16:08:28.576951 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=37b78a794211255319f797e3e69a22df8f5a828f029dbfa0f940236c6e12eaab I0427 16:08:28.576970 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.410287246s to process 1 records E0427 16:08:28.577025 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.411s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0427 16:08:28.578128 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0427 16:08:28.578141 1 periodic.go:216] Running workloads gatherer I0427 16:08:28.578155 1 tasks_processing.go:45] number of workers: 2 I0427 16:08:28.578161 1 tasks_processing.go:69] worker 1 listening for tasks. I0427 16:08:28.578165 1 tasks_processing.go:71] worker 1 working on workload_info task. I0427 16:08:28.578170 1 tasks_processing.go:69] worker 0 listening for tasks. I0427 16:08:28.578181 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0427 16:08:28.602089 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0427 16:08:28.607097 1 tasks_processing.go:74] worker 0 stopped. I0427 16:08:28.607112 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 28.903138ms to process 0 records I0427 16:08:28.610541 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (9ms) I0427 16:08:28.618370 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (8ms) I0427 16:08:28.626671 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (8ms) I0427 16:08:28.635347 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (9ms) I0427 16:08:28.643254 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (8ms) I0427 16:08:28.651275 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (8ms) I0427 16:08:28.659913 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (9ms) I0427 16:08:28.668450 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (9ms) I0427 16:08:28.676858 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (8ms) I0427 16:08:28.685309 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (8ms) I0427 16:08:28.709867 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (25ms) I0427 16:08:28.812734 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (103ms) I0427 16:08:28.911083 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (98ms) I0427 16:08:29.011674 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (101ms) I0427 16:08:29.110943 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (99ms) I0427 16:08:29.212248 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (101ms) I0427 16:08:29.310648 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (98ms) I0427 16:08:29.410752 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (100ms) I0427 16:08:29.511161 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0427 16:08:29.582094 1 configmapobserver.go:84] configmaps "insights-config" not found I0427 16:08:29.611284 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (100ms) I0427 16:08:29.710938 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (100ms) I0427 16:08:29.780887 1 configmapobserver.go:84] configmaps "insights-config" not found I0427 16:08:29.810726 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (100ms) I0427 16:08:29.910985 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0427 16:08:30.011067 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (100ms) I0427 16:08:30.111404 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (100ms) I0427 16:08:30.212029 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (101ms) I0427 16:08:30.311819 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (100ms) I0427 16:08:30.410980 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (99ms) I0427 16:08:30.511662 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (101ms) I0427 16:08:30.610796 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (99ms) I0427 16:08:30.712168 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (101ms) I0427 16:08:30.813113 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (101ms) I0427 16:08:30.912134 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (99ms) I0427 16:08:30.912171 1 tasks_processing.go:74] worker 1 stopped. E0427 16:08:30.912182 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0427 16:08:30.912485 1 recorder.go:75] Recording config/workload_info with fingerprint=468366d3285c7571144c6619da65b034c05730696333acea759bd1d5b9240506 I0427 16:08:30.912502 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.333998038s to process 1 records E0427 16:08:30.912526 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.334s with: function \"workload_info\" failed with an error" I0427 16:08:30.913626 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0427 16:08:30.913639 1 periodic.go:216] Running conditional gatherer I0427 16:08:30.919507 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0427 16:08:30.925965 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.12:39963->172.30.0.10:53: read: connection refused E0427 16:08:30.926266 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0427 16:08:30.926323 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0427 16:08:30.932053 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0427 16:08:30.932067 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0427 16:08:30.932072 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0427 16:08:30.932076 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0427 16:08:30.932079 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0427 16:08:30.932082 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0427 16:08:30.932086 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0427 16:08:30.932089 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0427 16:08:30.932091 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0427 16:08:30.932094 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0427 16:08:30.932112 1 tasks_processing.go:45] number of workers: 3 I0427 16:08:30.932132 1 tasks_processing.go:69] worker 2 listening for tasks. I0427 16:08:30.932139 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0427 16:08:30.932142 1 tasks_processing.go:69] worker 0 listening for tasks. I0427 16:08:30.932154 1 tasks_processing.go:69] worker 1 listening for tasks. I0427 16:08:30.932160 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0427 16:08:30.932169 1 tasks_processing.go:74] worker 1 stopped. I0427 16:08:30.932155 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0427 16:08:30.932230 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0427 16:08:30.932245 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 910ns to process 1 records I0427 16:08:30.932284 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0427 16:08:30.932293 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.262µs to process 1 records I0427 16:08:30.932298 1 tasks_processing.go:74] worker 0 stopped. I0427 16:08:30.932443 1 tasks_processing.go:74] worker 2 stopped. I0427 16:08:30.932456 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 255.794µs to process 0 records I0427 16:08:30.932478 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.12:39963->172.30.0.10:53: read: connection refused I0427 16:08:30.932495 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0427 16:08:30.955363 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=8df66ef5901bbc9dc9bb2e0f7c0726b2e64548cce8a5b2a460cd1a776479d826 I0427 16:08:30.955527 1 diskrecorder.go:70] Writing 111 records to /var/lib/insights-operator/insights-2026-04-27-160830.tar.gz I0427 16:08:30.962665 1 diskrecorder.go:51] Wrote 111 records to disk in 7ms I0427 16:08:30.962697 1 periodic.go:285] Gathering cluster info every 2h0m0s I0427 16:08:30.962712 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0427 16:08:41.223730 1 configmapobserver.go:84] configmaps "insights-config" not found I0427 16:09:44.577621 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="8c32b6cfa5c0d3bd26301e763dd6acce1ba9e965bfddfdb1e6b4982b8a4dc0e3") W0427 16:09:44.577652 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.key was created I0427 16:09:44.577706 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector