W0429 06:48:34.216215 1 cmd.go:257] Using insecure, self-signed certificates I0429 06:48:34.626647 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 06:48:34.626982 1 observer_polling.go:159] Starting file observer I0429 06:48:35.195961 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0429 06:48:35.196185 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0429 06:48:35.196692 1 secure_serving.go:57] Forcing use of http/1.1 only W0429 06:48:35.196724 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0429 06:48:35.196730 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0429 06:48:35.196734 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. I0429 06:48:35.196730 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0429 06:48:35.196737 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0429 06:48:35.196757 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0429 06:48:35.196764 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0429 06:48:35.205801 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0429 06:48:35.205823 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"0923b53a-1698-4c14-b535-d92ce9198934", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0429 06:48:35.208142 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0429 06:48:35.208160 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0429 06:48:35.208163 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0429 06:48:35.208163 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0429 06:48:35.208176 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0429 06:48:35.208180 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0429 06:48:35.208434 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2381771318/tls.crt::/tmp/serving-cert-2381771318/tls.key" I0429 06:48:35.208751 1 secure_serving.go:213] Serving securely on [::]:8443 I0429 06:48:35.208780 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0429 06:48:35.237895 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0429 06:48:35.237917 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0429 06:48:35.238018 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0429 06:48:35.275233 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0429 06:48:35.275260 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0429 06:48:35.285651 1 secretconfigobserver.go:119] support secret does not exist I0429 06:48:35.295089 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0429 06:48:35.306529 1 secretconfigobserver.go:119] support secret does not exist I0429 06:48:35.306691 1 recorder.go:176] Pruning old reports every 6h9m51s, max age is 288h0m0s I0429 06:48:35.308649 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0429 06:48:35.308725 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0429 06:48:35.308786 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0429 06:48:35.312231 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0429 06:48:35.312236 1 periodic.go:216] Running clusterconfig gatherer I0429 06:48:35.312250 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0429 06:48:35.312272 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0429 06:48:35.312275 1 tasks_processing.go:45] number of workers: 64 I0429 06:48:35.312276 1 insightsreport.go:296] Starting report retriever I0429 06:48:35.312282 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0429 06:48:35.312295 1 tasks_processing.go:69] worker 7 listening for tasks. I0429 06:48:35.312295 1 tasks_processing.go:69] worker 5 listening for tasks. I0429 06:48:35.312301 1 tasks_processing.go:69] worker 4 listening for tasks. I0429 06:48:35.312305 1 tasks_processing.go:69] worker 3 listening for tasks. I0429 06:48:35.312313 1 tasks_processing.go:69] worker 25 listening for tasks. I0429 06:48:35.312309 1 tasks_processing.go:69] worker 6 listening for tasks. I0429 06:48:35.312319 1 tasks_processing.go:69] worker 8 listening for tasks. I0429 06:48:35.312319 1 tasks_processing.go:69] worker 2 listening for tasks. I0429 06:48:35.312325 1 tasks_processing.go:69] worker 17 listening for tasks. I0429 06:48:35.312327 1 tasks_processing.go:69] worker 16 listening for tasks. I0429 06:48:35.312328 1 tasks_processing.go:71] worker 8 working on aggregated_monitoring_cr_names task. I0429 06:48:35.312328 1 tasks_processing.go:71] worker 2 working on certificate_signing_requests task. I0429 06:48:35.312336 1 tasks_processing.go:71] worker 16 working on authentication task. I0429 06:48:35.312339 1 tasks_processing.go:69] worker 19 listening for tasks. I0429 06:48:35.312339 1 tasks_processing.go:69] worker 0 listening for tasks. I0429 06:48:35.312349 1 tasks_processing.go:71] worker 0 working on machine_autoscalers task. I0429 06:48:35.312347 1 tasks_processing.go:69] worker 12 listening for tasks. I0429 06:48:35.312353 1 tasks_processing.go:71] worker 17 working on crds task. I0429 06:48:35.312364 1 tasks_processing.go:69] worker 22 listening for tasks. I0429 06:48:35.312371 1 tasks_processing.go:69] worker 11 listening for tasks. I0429 06:48:35.312331 1 tasks_processing.go:69] worker 18 listening for tasks. I0429 06:48:35.312377 1 tasks_processing.go:69] worker 23 listening for tasks. I0429 06:48:35.312379 1 tasks_processing.go:69] worker 9 listening for tasks. I0429 06:48:35.312389 1 tasks_processing.go:71] worker 11 working on container_runtime_configs task. I0429 06:48:35.312397 1 tasks_processing.go:71] worker 9 working on version task. I0429 06:48:35.312389 1 tasks_processing.go:69] worker 24 listening for tasks. I0429 06:48:35.312344 1 tasks_processing.go:71] worker 19 working on lokistack task. I0429 06:48:35.312408 1 tasks_processing.go:69] worker 36 listening for tasks. I0429 06:48:35.312419 1 tasks_processing.go:69] worker 26 listening for tasks. I0429 06:48:35.312410 1 tasks_processing.go:69] worker 48 listening for tasks. I0429 06:48:35.312383 1 tasks_processing.go:69] worker 13 listening for tasks. I0429 06:48:35.312426 1 tasks_processing.go:71] worker 12 working on openstack_dataplanenodesets task. I0429 06:48:35.312430 1 tasks_processing.go:69] worker 59 listening for tasks. I0429 06:48:35.312437 1 tasks_processing.go:69] worker 38 listening for tasks. I0429 06:48:35.312435 1 tasks_processing.go:69] worker 32 listening for tasks. I0429 06:48:35.312446 1 tasks_processing.go:69] worker 49 listening for tasks. I0429 06:48:35.312388 1 tasks_processing.go:69] worker 14 listening for tasks. I0429 06:48:35.312453 1 tasks_processing.go:69] worker 34 listening for tasks. I0429 06:48:35.312388 1 tasks_processing.go:71] worker 22 working on validating_webhook_configurations task. I0429 06:48:35.312455 1 tasks_processing.go:69] worker 31 listening for tasks. I0429 06:48:35.312461 1 tasks_processing.go:69] worker 50 listening for tasks. I0429 06:48:35.312428 1 tasks_processing.go:69] worker 37 listening for tasks. I0429 06:48:35.312472 1 tasks_processing.go:69] worker 43 listening for tasks. I0429 06:48:35.312484 1 tasks_processing.go:69] worker 47 listening for tasks. I0429 06:48:35.312487 1 tasks_processing.go:69] worker 53 listening for tasks. I0429 06:48:35.312497 1 tasks_processing.go:69] worker 30 listening for tasks. I0429 06:48:35.312442 1 tasks_processing.go:69] worker 33 listening for tasks. I0429 06:48:35.312385 1 tasks_processing.go:71] worker 18 working on proxies task. I0429 06:48:35.312527 1 tasks_processing.go:69] worker 40 listening for tasks. I0429 06:48:35.312349 1 tasks_processing.go:69] worker 20 listening for tasks. I0429 06:48:35.312534 1 tasks_processing.go:69] worker 56 listening for tasks. I0429 06:48:35.312536 1 tasks_processing.go:71] worker 5 working on machine_configs task. I0429 06:48:35.312462 1 tasks_processing.go:69] worker 44 listening for tasks. I0429 06:48:35.312543 1 tasks_processing.go:69] worker 54 listening for tasks. I0429 06:48:35.312489 1 tasks_processing.go:69] worker 29 listening for tasks. I0429 06:48:35.312356 1 tasks_processing.go:69] worker 21 listening for tasks. I0429 06:48:35.312550 1 tasks_processing.go:69] worker 55 listening for tasks. I0429 06:48:35.312548 1 tasks_processing.go:69] worker 42 listening for tasks. I0429 06:48:35.312554 1 tasks_processing.go:69] worker 58 listening for tasks. I0429 06:48:35.312469 1 tasks_processing.go:69] worker 45 listening for tasks. I0429 06:48:35.312559 1 tasks_processing.go:69] worker 27 listening for tasks. I0429 06:48:35.312563 1 tasks_processing.go:69] worker 62 listening for tasks. I0429 06:48:35.312468 1 tasks_processing.go:69] worker 51 listening for tasks. I0429 06:48:35.312476 1 tasks_processing.go:69] worker 46 listening for tasks. I0429 06:48:35.312569 1 tasks_processing.go:69] worker 63 listening for tasks. I0429 06:48:35.312572 1 tasks_processing.go:69] worker 60 listening for tasks. I0429 06:48:35.312575 1 tasks_processing.go:71] worker 25 working on install_plans task. I0429 06:48:35.312519 1 tasks_processing.go:69] worker 41 listening for tasks. I0429 06:48:35.312580 1 tasks_processing.go:69] worker 61 listening for tasks. I0429 06:48:35.312546 1 tasks_processing.go:69] worker 57 listening for tasks. I0429 06:48:35.312479 1 tasks_processing.go:69] worker 52 listening for tasks. I0429 06:48:35.312588 1 tasks_processing.go:71] worker 4 working on openstack_version task. I0429 06:48:35.312595 1 tasks_processing.go:69] worker 35 listening for tasks. I0429 06:48:35.312603 1 tasks_processing.go:71] worker 3 working on container_images task. I0429 06:48:35.312614 1 tasks_processing.go:71] worker 6 working on openshift_logging task. I0429 06:48:35.312384 1 tasks_processing.go:71] worker 23 working on dvo_metrics task. I0429 06:48:35.312454 1 tasks_processing.go:69] worker 39 listening for tasks. I0429 06:48:35.312324 1 tasks_processing.go:69] worker 1 listening for tasks. I0429 06:48:35.312366 1 tasks_processing.go:69] worker 10 listening for tasks. I0429 06:48:35.312393 1 tasks_processing.go:69] worker 15 listening for tasks. I0429 06:48:35.312861 1 tasks_processing.go:71] worker 13 working on machine_config_pools task. I0429 06:48:35.312884 1 tasks_processing.go:71] worker 29 working on jaegers task. I0429 06:48:35.312895 1 tasks_processing.go:71] worker 36 working on qemu_kubevirt_launcher_logs task. I0429 06:48:35.312991 1 tasks_processing.go:71] worker 24 working on nodes task. I0429 06:48:35.313035 1 tasks_processing.go:71] worker 59 working on pod_network_connectivity_checks task. I0429 06:48:35.313056 1 tasks_processing.go:71] worker 26 working on cluster_apiserver task. I0429 06:48:35.313126 1 tasks_processing.go:71] worker 7 working on nodenetworkstates task. I0429 06:48:35.313166 1 tasks_processing.go:71] worker 43 working on infrastructures task. I0429 06:48:35.313241 1 tasks_processing.go:71] worker 14 working on storage_classes task. I0429 06:48:35.313255 1 tasks_processing.go:71] worker 31 working on clusterroles task. I0429 06:48:35.313269 1 tasks_processing.go:71] worker 34 working on pdbs task. I0429 06:48:35.313359 1 tasks_processing.go:71] worker 20 working on sap_datahubs task. I0429 06:48:35.313454 1 tasks_processing.go:71] worker 63 working on oauths task. I0429 06:48:35.313463 1 tasks_processing.go:71] worker 56 working on networks task. I0429 06:48:35.313576 1 tasks_processing.go:71] worker 30 working on mutating_webhook_configurations task. I0429 06:48:35.313581 1 tasks_processing.go:71] worker 53 working on service_accounts task. I0429 06:48:35.313600 1 tasks_processing.go:71] worker 52 working on node_features task. I0429 06:48:35.313606 1 tasks_processing.go:71] worker 21 working on monitoring_persistent_volumes task. I0429 06:48:35.313136 1 tasks_processing.go:71] worker 48 working on sap_config task. I0429 06:48:35.313745 1 tasks_processing.go:71] worker 41 working on image_pruners task. I0429 06:48:35.313777 1 tasks_processing.go:71] worker 50 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0429 06:48:35.313784 1 tasks_processing.go:71] worker 61 working on operators task. I0429 06:48:35.313844 1 tasks_processing.go:71] worker 60 working on node_logs task. I0429 06:48:35.313857 1 tasks_processing.go:71] worker 57 working on tsdb_status task. W0429 06:48:35.313880 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 06:48:35.313888 1 tasks_processing.go:71] worker 47 working on machine_sets task. I0429 06:48:35.313888 1 tasks_processing.go:71] worker 40 working on ingress_certificates task. I0429 06:48:35.313903 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 26.504µs to process 0 records I0429 06:48:35.313913 1 tasks_processing.go:71] worker 45 working on feature_gates task. I0429 06:48:35.313919 1 tasks_processing.go:71] worker 35 working on machine_healthchecks task. I0429 06:48:35.313939 1 tasks_processing.go:71] worker 33 working on metrics task. I0429 06:48:35.313943 1 tasks_processing.go:71] worker 32 working on active_alerts task. W0429 06:48:35.313957 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 06:48:35.313969 1 tasks_processing.go:71] worker 42 working on cost_management_metrics_configs task. I0429 06:48:35.313976 1 tasks_processing.go:71] worker 38 working on silenced_alerts task. I0429 06:48:35.313977 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 23.73µs to process 0 records I0429 06:48:35.313990 1 tasks_processing.go:71] worker 1 working on operators_pods_and_events task. I0429 06:48:35.313994 1 tasks_processing.go:71] worker 10 working on openshift_machine_api_events task. I0429 06:48:35.314475 1 tasks_processing.go:71] worker 46 working on ceph_cluster task. I0429 06:48:35.314608 1 tasks_processing.go:71] worker 55 working on openstack_dataplanedeployments task. I0429 06:48:35.313911 1 tasks_processing.go:71] worker 15 working on image task. I0429 06:48:35.314799 1 tasks_processing.go:71] worker 44 working on support_secret task. I0429 06:48:35.314892 1 tasks_processing.go:71] worker 54 working on nodenetworkconfigurationpolicies task. W0429 06:48:35.313995 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 06:48:35.315030 1 tasks_processing.go:71] worker 38 working on image_registries task. W0429 06:48:35.313968 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 06:48:35.314367 1 tasks_processing.go:71] worker 39 working on overlapping_namespace_uids task. I0429 06:48:35.315192 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 973.898µs to process 0 records I0429 06:48:35.315217 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.141837ms to process 0 records I0429 06:48:35.315280 1 tasks_processing.go:74] worker 32 stopped. I0429 06:48:35.313893 1 tasks_processing.go:71] worker 57 working on storage_cluster task. I0429 06:48:35.314379 1 tasks_processing.go:71] worker 37 working on machines task. I0429 06:48:35.314377 1 tasks_processing.go:71] worker 27 working on config_maps task. I0429 06:48:35.314406 1 tasks_processing.go:71] worker 58 working on ingress task. I0429 06:48:35.313969 1 tasks_processing.go:71] worker 33 working on sap_pods task. I0429 06:48:35.314461 1 tasks_processing.go:71] worker 62 working on schedulers task. I0429 06:48:35.314469 1 tasks_processing.go:71] worker 51 working on openstack_controlplanes task. I0429 06:48:35.314469 1 tasks_processing.go:71] worker 49 working on olm_operators task. I0429 06:48:35.314464 1 tasks_processing.go:69] worker 28 listening for tasks. I0429 06:48:35.315901 1 tasks_processing.go:74] worker 28 stopped. I0429 06:48:35.324880 1 tasks_processing.go:74] worker 13 stopped. I0429 06:48:35.324901 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 12.00904ms to process 0 records I0429 06:48:35.324913 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 12.533352ms to process 0 records I0429 06:48:35.324920 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 12.294904ms to process 0 records I0429 06:48:35.324926 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 12.468785ms to process 0 records I0429 06:48:35.324931 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 12.292793ms to process 0 records I0429 06:48:35.324936 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 12.513293ms to process 0 records I0429 06:48:35.324942 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 12.023391ms to process 0 records I0429 06:48:35.324949 1 tasks_processing.go:74] worker 29 stopped. I0429 06:48:35.324953 1 tasks_processing.go:74] worker 0 stopped. I0429 06:48:35.324958 1 tasks_processing.go:74] worker 4 stopped. I0429 06:48:35.324963 1 tasks_processing.go:74] worker 12 stopped. I0429 06:48:35.324967 1 tasks_processing.go:74] worker 6 stopped. I0429 06:48:35.324975 1 tasks_processing.go:74] worker 11 stopped. I0429 06:48:35.338375 1 base_controller.go:82] Caches are synced for ConfigController I0429 06:48:35.338388 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0429 06:48:35.344199 1 tasks_processing.go:74] worker 55 stopped. I0429 06:48:35.344213 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 29.534079ms to process 0 records I0429 06:48:35.344258 1 tasks_processing.go:74] worker 42 stopped. I0429 06:48:35.344276 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 30.276196ms to process 0 records I0429 06:48:35.344287 1 gather_logs.go:145] no pods in namespace were found E0429 06:48:35.344294 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0429 06:48:35.344304 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 31.227363ms to process 0 records I0429 06:48:35.344311 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 31.391779ms to process 0 records I0429 06:48:35.344319 1 tasks_processing.go:74] worker 36 stopped. I0429 06:48:35.344322 1 tasks_processing.go:74] worker 59 stopped. I0429 06:48:35.344386 1 tasks_processing.go:74] worker 35 stopped. E0429 06:48:35.344396 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0429 06:48:35.344402 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 30.452459ms to process 0 records I0429 06:48:35.344551 1 tasks_processing.go:74] worker 56 stopped. I0429 06:48:35.344819 1 recorder.go:75] Recording config/network with fingerprint=74e1cba08361e3a75b4d5543a951173710c1e274533de2b048d151344d5fc7c9 I0429 06:48:35.344839 1 gather.go:177] gatherer "clusterconfig" function "networks" took 31.073123ms to process 1 records I0429 06:48:35.346195 1 tasks_processing.go:74] worker 43 stopped. I0429 06:48:35.346695 1 recorder.go:75] Recording config/infrastructure with fingerprint=7b98afc7d2bb47b8897ebb09f3e89b36541a034083ad813fe1a17b3d0f3087fb I0429 06:48:35.346728 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 33.010657ms to process 1 records I0429 06:48:35.346828 1 tasks_processing.go:74] worker 63 stopped. I0429 06:48:35.346895 1 recorder.go:75] Recording config/oauth with fingerprint=4120a9f4ac608b5e178c8acb4ad25e6730d8937a0eb8f1f824ab6f068bb806bc I0429 06:48:35.346903 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 32.886702ms to process 1 records I0429 06:48:35.346913 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 33.442156ms to process 0 records I0429 06:48:35.346917 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 33.706249ms to process 0 records I0429 06:48:35.346922 1 tasks_processing.go:74] worker 7 stopped. I0429 06:48:35.346925 1 tasks_processing.go:74] worker 20 stopped. E0429 06:48:35.354002 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0429 06:48:35.354014 1 tasks_processing.go:74] worker 52 stopped. I0429 06:48:35.354024 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 40.405088ms to process 0 records I0429 06:48:35.354032 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 40.31122ms to process 0 records I0429 06:48:35.354040 1 tasks_processing.go:74] worker 48 stopped. I0429 06:48:35.354041 1 tasks_processing.go:74] worker 57 stopped. I0429 06:48:35.354054 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 38.677032ms to process 0 records I0429 06:48:35.354511 1 tasks_processing.go:74] worker 34 stopped. I0429 06:48:35.354663 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=d452566562c1c05a3e9edb3004e574dd62c5a468ec141f43aac429805ea71a66 I0429 06:48:35.354717 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=181c2a71beb84cd0a3a75b420641674ce86f6b7544178dc14d7a562a7e1a58cd I0429 06:48:35.354749 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=7e338d818af8c2c480b498f9cf0f10b7a959f9df1af79a0bab4c3d0eb18d780e I0429 06:48:35.354763 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 41.233296ms to process 3 records I0429 06:48:35.355081 1 tasks_processing.go:74] worker 37 stopped. E0429 06:48:35.355101 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0429 06:48:35.355115 1 gather.go:177] gatherer "clusterconfig" function "machines" took 39.607795ms to process 0 records I0429 06:48:35.355333 1 tasks_processing.go:74] worker 21 stopped. I0429 06:48:35.355347 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 41.717483ms to process 0 records I0429 06:48:35.355435 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=4e2a7b9a90343be832099a69e92e599a9ef2e18d60dc9ef1df7232cc83419ecd I0429 06:48:35.355456 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=e664a710ca88f77c82b1b4b4a8cf529db939a05982fe314a37cf409231ba268a I0429 06:48:35.355460 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 42.083025ms to process 2 records I0429 06:48:35.355465 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 39.707929ms to process 0 records I0429 06:48:35.355474 1 tasks_processing.go:74] worker 33 stopped. I0429 06:48:35.355477 1 tasks_processing.go:74] worker 14 stopped. I0429 06:48:35.355549 1 tasks_processing.go:74] worker 30 stopped. I0429 06:48:35.355622 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=124def4eaf184d249762d8b19a07036ea1efad721522af44fd956242a04d6d2e I0429 06:48:35.355653 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=08f0f5799d24a92394a12d1ccb8548e227f1fa634932ff6ceb320ed4108661c2 I0429 06:48:35.355687 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=11c1c588194f7d92c313335d65537a744be89f1945767ce29c6f5d0cd08299de I0429 06:48:35.355695 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 41.879871ms to process 3 records I0429 06:48:35.355714 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 43.165201ms to process 0 records I0429 06:48:35.355787 1 tasks_processing.go:74] worker 19 stopped. I0429 06:48:35.355802 1 recorder.go:75] Recording config/featuregate with fingerprint=20e2b12dba72f65ca7707f2316ae62ca77c2a9a7bbbbb91462624c2bd5637204 I0429 06:48:35.355808 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 41.704535ms to process 1 records I0429 06:48:35.355813 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 39.880583ms to process 0 records I0429 06:48:35.355819 1 tasks_processing.go:74] worker 51 stopped. I0429 06:48:35.355823 1 tasks_processing.go:74] worker 45 stopped. I0429 06:48:35.357508 1 tasks_processing.go:74] worker 54 stopped. I0429 06:48:35.357528 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 42.598219ms to process 0 records I0429 06:48:35.357565 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0429 06:48:35.357617 1 tasks_processing.go:74] worker 18 stopped. I0429 06:48:35.357630 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0429 06:48:35.357637 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0429 06:48:35.357641 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0429 06:48:35.357674 1 controller.go:531] The operator is still being initialized I0429 06:48:35.357686 1 controller.go:554] The operator is healthy I0429 06:48:35.357834 1 recorder.go:75] Recording config/proxy with fingerprint=9aabc09cf7e580331e129aeef484a4529dae67f4d0bf90a8b48c351aa23f4409 I0429 06:48:35.357857 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 45.087209ms to process 1 records I0429 06:48:35.357868 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 43.148371ms to process 0 records I0429 06:48:35.357925 1 tasks_processing.go:74] worker 41 stopped. I0429 06:48:35.357936 1 tasks_processing.go:74] worker 46 stopped. I0429 06:48:35.358368 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=42629645201d4efe21783b7a42e50627ccebe46ad5ce9e419698778e3559021d I0429 06:48:35.358387 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 43.930375ms to process 1 records I0429 06:48:35.358743 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 43.797508ms to process 0 records I0429 06:48:35.358809 1 tasks_processing.go:74] worker 47 stopped. I0429 06:48:35.358880 1 tasks_processing.go:74] worker 16 stopped. I0429 06:48:35.358951 1 recorder.go:75] Recording config/authentication with fingerprint=173959bbb8580c550b3a21eb731c9e93b81c24006dae8720d44338c1c0af41c8 I0429 06:48:35.358970 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 45.653913ms to process 1 records I0429 06:48:35.359073 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=f36f87bb0d68a387a390ada7677299392ef6b7fa4c6104dc0d7530fda860b275 I0429 06:48:35.359070 1 tasks_processing.go:74] worker 22 stopped. I0429 06:48:35.359149 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=f760513ccc53a804fb333fdfd2641fcc1b28ba580f3f5431574c9008b737a12f I0429 06:48:35.359170 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=41557b6563e88328c82247c94d40ca132382acc65499bf536b15cc25d36ec224 I0429 06:48:35.359195 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=98affa344182f211b137a52441fee5b035a87f2b74110188d91bc15e68dc6402 I0429 06:48:35.359218 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=85de4228b6b8f8bc04ef6b0a146259a54919d185e1c390d4c69f7c68460cfd7e I0429 06:48:35.359249 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=e0051dd7e8cfe8caa9e9d16b2b206b9738ea37fa603cd01a1103e9b7e64ee4ef I0429 06:48:35.359290 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=caec5f52b15db56b452af2f938a138aeeb9bb71b4ef7dbe62b3c27846a0a1a3e I0429 06:48:35.359324 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=e70df1dcbc2d40f48242ae45f1eba0794f2ebee004579cae02235df632e2da7f I0429 06:48:35.359345 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=9a217e2565a8b194eb99e0494956a173e0b92999afb638878d0c93d4e56b08d8 I0429 06:48:35.359366 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f3f91eae12f1d2bbb4eea5d597e85217892ef35afb7c8a1b03283e1df7afb72e I0429 06:48:35.359397 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=0c6b8ba29a92441b26b8473a4452269aaaf8475a85db4ad83a12358066cc52f6 I0429 06:48:35.359403 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 45.607632ms to process 11 records I0429 06:48:35.359518 1 tasks_processing.go:74] worker 15 stopped. I0429 06:48:35.359522 1 recorder.go:75] Recording config/image with fingerprint=7b0b62534e2837e58a0c3b0ad497fa87d601a4515f574d4b2582dea9d5a1614b I0429 06:48:35.359536 1 gather.go:177] gatherer "clusterconfig" function "image" took 43.549383ms to process 1 records I0429 06:48:35.359631 1 tasks_processing.go:74] worker 58 stopped. I0429 06:48:35.359663 1 recorder.go:75] Recording config/ingress with fingerprint=2e045a9918d139dd64182235d2efcef9c24966e20db8b577ea3f7e4841ac3bae I0429 06:48:35.359673 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 43.276221ms to process 1 records I0429 06:48:35.359727 1 tasks_processing.go:74] worker 38 stopped. I0429 06:48:35.360040 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=3de723487e88faea477ffdf3fff1b2a6cdc5d0eb5c46b0e4cc4430583d39ce64 I0429 06:48:35.360069 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 44.220771ms to process 1 records I0429 06:48:35.360088 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 47.113197ms to process 0 records I0429 06:48:35.360132 1 tasks_processing.go:74] worker 2 stopped. W0429 06:48:35.362662 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 06:48:35.364022 1 tasks_processing.go:74] worker 5 stopped. E0429 06:48:35.364036 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0429 06:48:35.364063 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0429 06:48:35.364076 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 51.476217ms to process 1 records I0429 06:48:35.364215 1 tasks_processing.go:74] worker 62 stopped. I0429 06:48:35.364280 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=5014a0a7b8bad6718ad4166306a28dd9bc7765a2c8afafc6d23c7b180e96920c I0429 06:48:35.364291 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 48.469835ms to process 1 records I0429 06:48:35.368907 1 tasks_processing.go:74] worker 44 stopped. I0429 06:48:35.368914 1 configmapobserver.go:84] configmaps "insights-config" not found E0429 06:48:35.368919 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0429 06:48:35.368926 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 54.084882ms to process 0 records I0429 06:48:35.369940 1 tasks_processing.go:74] worker 26 stopped. I0429 06:48:35.370055 1 recorder.go:75] Recording config/apiserver with fingerprint=a1b9a5bcf69e9baada740651f5007237cac270aa57b3b5ff0ff4f88c879b045c I0429 06:48:35.370067 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 56.863775ms to process 1 records I0429 06:48:35.372561 1 tasks_processing.go:74] worker 60 stopped. I0429 06:48:35.372576 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 58.704627ms to process 0 records I0429 06:48:35.372729 1 tasks_processing.go:74] worker 49 stopped. I0429 06:48:35.372742 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 56.866302ms to process 0 records I0429 06:48:35.372778 1 tasks_processing.go:74] worker 10 stopped. I0429 06:48:35.372794 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 58.292574ms to process 0 records I0429 06:48:35.372839 1 tasks_processing.go:74] worker 31 stopped. I0429 06:48:35.373004 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=0ba408d068e1e33766280fadb0d3304dba8da485d3e33b8ff86683ff10ffd781 I0429 06:48:35.373087 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=14c3404a873f7f1ade75f8301da0c828a3304f5a03ac96669002514f46b45187 I0429 06:48:35.373095 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 59.576471ms to process 2 records I0429 06:48:35.373117 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0429 06:48:35.373126 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 57.870175ms to process 1 records I0429 06:48:35.373180 1 tasks_processing.go:74] worker 39 stopped. I0429 06:48:35.373247 1 tasks_processing.go:74] worker 24 stopped. I0429 06:48:35.373363 1 recorder.go:75] Recording config/node/ip-10-0-0-41.ec2.internal with fingerprint=7c262fccc81094bfb5ff7d2b13775b8f1262154efdc5000416527f6a4c6b5d6c I0429 06:48:35.373414 1 recorder.go:75] Recording config/node/ip-10-0-1-61.ec2.internal with fingerprint=beaa57dfe872e93549e17831ace3f7f72d9c120429e48cfa302c5e738fabacfb I0429 06:48:35.373463 1 recorder.go:75] Recording config/node/ip-10-0-2-36.ec2.internal with fingerprint=c61c69b045359481dd4cd391cf59074f353e7b31d600b2188aa49f347cbdfd40 I0429 06:48:35.373469 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 59.988783ms to process 3 records I0429 06:48:35.381590 1 tasks_processing.go:74] worker 17 stopped. I0429 06:48:35.382335 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=ca61ab7f073eefb5184fa4cbd8f836f79b05e878257d28123c24652a572f8ea8 I0429 06:48:35.382670 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=0fe45ce6c7d9c6898bc128db9d477b2cf8c7929b26672de68cdba8aa87416591 I0429 06:48:35.382683 1 gather.go:177] gatherer "clusterconfig" function "crds" took 69.212991ms to process 2 records I0429 06:48:35.382715 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 69.388115ms to process 0 records I0429 06:48:35.382725 1 tasks_processing.go:74] worker 8 stopped. I0429 06:48:35.387052 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0429 06:48:35.387067 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0429 06:48:35.387181 1 operator.go:328] started I0429 06:48:35.387206 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0429 06:48:35.405180 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0429 06:48:35.405193 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0429 06:48:35.405198 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0429 06:48:35.405204 1 controller.go:254] Source scaController *sca.Controller is not ready I0429 06:48:35.405208 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0429 06:48:35.405227 1 controller.go:531] The operator is still being initialized I0429 06:48:35.405232 1 controller.go:554] The operator is healthy I0429 06:48:35.407995 1 prometheus_rules.go:88] Prometheus rules successfully created E0429 06:48:35.418336 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27da3cb607-3630-4389-bec2-3225cb465234%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.8:55661->172.30.0.10:53: read: connection refused I0429 06:48:35.418351 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27da3cb607-3630-4389-bec2-3225cb465234%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.8:55661->172.30.0.10:53: read: connection refused I0429 06:48:35.421273 1 tasks_processing.go:74] worker 27 stopped. E0429 06:48:35.421286 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0429 06:48:35.421292 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0429 06:48:35.421295 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0429 06:48:35.421304 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0429 06:48:35.421337 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0429 06:48:35.421343 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0429 06:48:35.421348 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0429 06:48:35.421352 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0429 06:48:35.421389 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0429 06:48:35.421396 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0429 06:48:35.421401 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 105.745342ms to process 7 records I0429 06:48:35.431374 1 tasks_processing.go:74] worker 9 stopped. I0429 06:48:35.431656 1 recorder.go:75] Recording config/version with fingerprint=ccce983084bb88b2c8d5a8192e24a020f2625669ba981a6a4549b45fb21d95f2 I0429 06:48:35.431672 1 recorder.go:75] Recording config/id with fingerprint=d30bc93039d3804521d022b7ccaa499c87ecfa59618f9000d081cb49e9f71f54 I0429 06:48:35.431681 1 gather.go:177] gatherer "clusterconfig" function "version" took 118.968917ms to process 2 records I0429 06:48:35.448149 1 tasks_processing.go:74] worker 3 stopped. I0429 06:48:35.448332 1 recorder.go:75] Recording config/running_containers with fingerprint=3a17fb4fa80aa034ed569fc743d7270a30e714b55e16d011e68179e218c36011 I0429 06:48:35.448397 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 135.523765ms to process 1 records I0429 06:48:35.452469 1 tasks_processing.go:74] worker 50 stopped. I0429 06:48:35.452489 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 138.673138ms to process 0 records I0429 06:48:35.481665 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0429 06:48:35.485298 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.8:48160->172.30.0.10:53: read: connection refused I0429 06:48:35.485313 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.8:48160->172.30.0.10:53: read: connection refused I0429 06:48:35.487397 1 base_controller.go:82] Caches are synced for LoggingSyncer I0429 06:48:35.487409 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0429 06:48:35.505436 1 tasks_processing.go:74] worker 40 stopped. E0429 06:48:35.505450 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0429 06:48:35.505457 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pvlgkdgsf526nqovfd11k6703l08h7f-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pvlgkdgsf526nqovfd11k6703l08h7f-primary-cert-bundle-secret" not found I0429 06:48:35.505513 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=28f708ec8f34ee1f7741232b57e099b427512c6456315334419ab5efd83f1359 I0429 06:48:35.505526 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 191.530723ms to process 1 records I0429 06:48:35.778431 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0429 06:48:35.778446 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0429 06:48:35.779105 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-29lmq pod in namespace openshift-dns (previous: false). I0429 06:48:36.019577 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-29lmq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-29lmq\" is waiting to start: ContainerCreating" I0429 06:48:36.019597 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-29lmq\" is waiting to start: ContainerCreating" I0429 06:48:36.019611 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-29lmq pod in namespace openshift-dns (previous: false). I0429 06:48:36.187181 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-29lmq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-29lmq\" is waiting to start: ContainerCreating" I0429 06:48:36.187199 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-29lmq\" is waiting to start: ContainerCreating" I0429 06:48:36.187209 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-8cwxg pod in namespace openshift-dns (previous: false). W0429 06:48:36.362120 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 06:48:36.404616 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-8cwxg pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-8cwxg\" is waiting to start: ContainerCreating" I0429 06:48:36.404631 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-8cwxg\" is waiting to start: ContainerCreating" I0429 06:48:36.404638 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-8cwxg pod in namespace openshift-dns (previous: false). I0429 06:48:36.584744 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-8cwxg pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-8cwxg\" is waiting to start: ContainerCreating" I0429 06:48:36.584759 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-8cwxg\" is waiting to start: ContainerCreating" I0429 06:48:36.584769 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jmf4w pod in namespace openshift-dns (previous: false). I0429 06:48:36.804034 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0429 06:48:36.816819 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jmf4w pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-jmf4w\" is waiting to start: ContainerCreating" I0429 06:48:36.816834 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-jmf4w\" is waiting to start: ContainerCreating" I0429 06:48:36.816842 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jmf4w pod in namespace openshift-dns (previous: false). I0429 06:48:36.984568 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jmf4w pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-jmf4w\" is waiting to start: ContainerCreating" I0429 06:48:36.984580 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-jmf4w\" is waiting to start: ContainerCreating" I0429 06:48:36.984589 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-gbfqw pod in namespace openshift-dns (previous: false). I0429 06:48:37.185715 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 06:48:37.185728 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-qljpk pod in namespace openshift-dns (previous: false). W0429 06:48:37.362091 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 06:48:37.384484 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 06:48:37.384498 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-qz9dh pod in namespace openshift-dns (previous: false). I0429 06:48:37.406242 1 tasks_processing.go:74] worker 61 stopped. I0429 06:48:37.406287 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=978210513c3c887666ebc407d8a862f9d05f57bb8fb726784e2fc52a794c8531 I0429 06:48:37.406329 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=c198364859106f4d8661839d003ed034b7d7a73deca35e7903451890d2082f57 I0429 06:48:37.406359 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0429 06:48:37.406384 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=d5b34aa3d2fadbd8ed2e77068fb81d6ce54487a9f6c8fd6fc2756cd17e37c4f9 I0429 06:48:37.406400 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0429 06:48:37.406421 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=205e7e1c5cfc893797f2ef83828459c839e5670abee0742e4cc58bd1d793be16 I0429 06:48:37.406468 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=9b25fb423d2d9c1be2a5e799ff9dca1f7550f8eec1caa4049c36e1d9162af14d I0429 06:48:37.406491 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=7c5224e3385928c1873b755943bd45b86b64a77ae4cd634191e9e85bead5ddd3 I0429 06:48:37.406505 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=21d4e892933ea874865058055932f0d0dc47aeb73aa1eb946ff0b572e851484a I0429 06:48:37.406521 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=fafe1e0e7a38745ec5e3ee2644f78a6550aa233ed3e27a7924b9c685cdf0a01a I0429 06:48:37.406531 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0429 06:48:37.406546 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=ec61cb2301333a3bb93f548a289abaccc579b3c5ac06467903a81de46d53d82f I0429 06:48:37.406557 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0429 06:48:37.406573 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=f7864609cd7739dec4e955077db021bba1b56678ad715554ca07d787c141bb82 I0429 06:48:37.406582 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0429 06:48:37.406594 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=d79ca0a89abe5474ad15268c4707919c23a845f074d21649a65a65b8f11cf047 I0429 06:48:37.406603 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0429 06:48:37.406617 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=290efa238617c058efd3490225d749d2edd49919bbee1068454627d1737b3844 I0429 06:48:37.406759 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=f9028b18a18882fd709e12195e20925b31553700825756681a4dbdbd3e937d81 I0429 06:48:37.406769 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0429 06:48:37.406776 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0429 06:48:37.406796 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0429 06:48:37.406820 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=3b007572b350658ae3b9005c52a1adf87c139e2d6d1a05732aaa83fdf7c5a8fc I0429 06:48:37.406843 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=4db8fb45c2c1f0b90b3ae12245d1fba32fdbe7dad93dab46bf4143e9331d427e I0429 06:48:37.406853 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0429 06:48:37.406869 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=7dda7258d56d0751625d785d45f91362b087cee7b31198270d357dcbd7d57584 I0429 06:48:37.406878 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0429 06:48:37.406891 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=1fa9eb008944b3bbc27375aa746bf58be29caf90dd071385ce9773c4545d0b58 I0429 06:48:37.406904 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=d7346131228c09af519bbf43114587a905fc35384d38f7f43cb31a24a89e2124 I0429 06:48:37.406918 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=01f819606117f99c1027cdef8a8827ade9bbe62239c8282e02b6a3f6aaf0c476 I0429 06:48:37.406931 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=bfb2728768f06971f2659d36319f670a1b5dbce646d94e07abc41a66d407e8e3 I0429 06:48:37.406949 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=ff00453b79b7704d650f75f2c4631e6531e69b59a15d6d62d4bc2885c3d6c93c I0429 06:48:37.406960 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0429 06:48:37.406987 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=c482e7387448db589b60c206169cefbdcf8c014cacd1e9c38f898c2e1f3e317b I0429 06:48:37.407003 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0429 06:48:37.407009 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0429 06:48:37.407015 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.092441059s to process 36 records I0429 06:48:37.587108 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 06:48:37.587128 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-76d6dbccdd-52h2m pod in namespace openshift-image-registry (previous: false). I0429 06:48:37.786925 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-76d6dbccdd-52h2m pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-76d6dbccdd-52h2m\" is waiting to start: ContainerCreating" I0429 06:48:37.786939 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-76d6dbccdd-52h2m\" is waiting to start: ContainerCreating" I0429 06:48:37.786948 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-76d6dbccdd-dsjbb pod in namespace openshift-image-registry (previous: false). I0429 06:48:37.983815 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-76d6dbccdd-dsjbb pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-76d6dbccdd-dsjbb\" is waiting to start: ContainerCreating" I0429 06:48:37.983829 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-76d6dbccdd-dsjbb\" is waiting to start: ContainerCreating" I0429 06:48:37.983838 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-77769f5bc5-qtsp7 pod in namespace openshift-image-registry (previous: false). I0429 06:48:38.184242 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-77769f5bc5-qtsp7 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-77769f5bc5-qtsp7\" is waiting to start: ContainerCreating" I0429 06:48:38.184255 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-77769f5bc5-qtsp7\" is waiting to start: ContainerCreating" I0429 06:48:38.184264 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-ftdp5 pod in namespace openshift-image-registry (previous: false). W0429 06:48:38.362408 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 06:48:38.384841 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 06:48:38.384853 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-j7hjl pod in namespace openshift-image-registry (previous: false). I0429 06:48:38.585927 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 06:48:38.585941 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-qsgp2 pod in namespace openshift-image-registry (previous: false). I0429 06:48:38.784360 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0429 06:48:38.784374 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-57d97dff8f-95hdv pod in namespace openshift-ingress (previous: false). I0429 06:48:38.984571 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-57d97dff8f-95hdv pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-57d97dff8f-95hdv\" is waiting to start: ContainerCreating" I0429 06:48:38.984584 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-57d97dff8f-95hdv\" is waiting to start: ContainerCreating" I0429 06:48:38.984592 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7d9696c95d-4kc2q pod in namespace openshift-ingress (previous: false). I0429 06:48:39.183231 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7d9696c95d-4kc2q pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7d9696c95d-4kc2q\" is waiting to start: ContainerCreating" I0429 06:48:39.183244 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7d9696c95d-4kc2q\" is waiting to start: ContainerCreating" I0429 06:48:39.183253 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7d9696c95d-4vdv8 pod in namespace openshift-ingress (previous: false). W0429 06:48:39.362394 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0429 06:48:39.386954 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7d9696c95d-4vdv8 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7d9696c95d-4vdv8\" is waiting to start: ContainerCreating" I0429 06:48:39.386967 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7d9696c95d-4vdv8\" is waiting to start: ContainerCreating" I0429 06:48:39.386979 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-9hd9r pod in namespace openshift-ingress-canary (previous: false). I0429 06:48:39.585442 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-gr9s7 pod in namespace openshift-ingress-canary (previous: false). I0429 06:48:39.786795 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-qt6ch pod in namespace openshift-ingress-canary (previous: false). I0429 06:48:39.985297 1 tasks_processing.go:74] worker 1 stopped. I0429 06:48:39.985375 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=6f0904ddf10ee3ebf89ece08fb34ed44ffa482e618f807b83a0768d749368112 I0429 06:48:39.985424 1 recorder.go:75] Recording events/openshift-dns with fingerprint=1a4ecd8e2197ad36cf838bf41b606da2a186b892eed7afdf5b869191935e79ce I0429 06:48:39.985507 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=c561b64d07578b25310023c5bca2350d8b3c1be5fd70ab4673120fe07022d8cc I0429 06:48:39.985536 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=049e1a3b085e839edce4a51068c3759a0d53b9fd6f3e5100b0d64506dd69f827 I0429 06:48:39.985581 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=43694d77f240a8d1896d5175d05899be3b3b282b92760c5e29691d664709026a I0429 06:48:39.985618 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=63c5cfdb3905e6057dd9d20c1c2fe90b1cd7f40cdc55f83a648527b9ebd5ba32 I0429 06:48:39.985625 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-9hd9r/serve-healthcheck-canary_current.log with fingerprint=648d44de055ac0f940113d8e076e174e8fdf5cc2e9b2da120170d7d22b06aa48 I0429 06:48:39.985630 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-gr9s7/serve-healthcheck-canary_current.log with fingerprint=2b30385c4d89cd1cbe23f5f3f612b350fa5820546697b4a2f066d5a1c7338fdc I0429 06:48:39.985635 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-qt6ch/serve-healthcheck-canary_current.log with fingerprint=013667cabe0070a7d8b6799b981b6d73931c817b6db758d68ce6987d12bc2f48 I0429 06:48:39.985641 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.671293193s to process 9 records W0429 06:48:40.359258 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0429 06:48:40.359283 1 tasks_processing.go:74] worker 23 stopped. E0429 06:48:40.359296 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0429 06:48:40.359308 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0429 06:48:40.359322 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0429 06:48:40.359331 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.04662271s to process 1 records I0429 06:48:47.763528 1 tasks_processing.go:74] worker 25 stopped. I0429 06:48:47.763565 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0429 06:48:47.763579 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.450937294s to process 1 records I0429 06:48:48.300173 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 06:48:48.521103 1 tasks_processing.go:74] worker 53 stopped. I0429 06:48:48.521372 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=698b3ed6ac2dcbbe305b75e3c37787498192c269ee2964c1d49d551d6371b6d6 I0429 06:48:48.521388 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.207500741s to process 1 records E0429 06:48:48.521465 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.209s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0429 06:48:48.522571 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0429 06:48:48.522585 1 periodic.go:216] Running workloads gatherer I0429 06:48:48.522603 1 tasks_processing.go:45] number of workers: 2 I0429 06:48:48.522618 1 tasks_processing.go:69] worker 1 listening for tasks. I0429 06:48:48.522624 1 tasks_processing.go:71] worker 1 working on workload_info task. I0429 06:48:48.522628 1 tasks_processing.go:69] worker 0 listening for tasks. I0429 06:48:48.522638 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0429 06:48:48.548832 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0429 06:48:48.556717 1 tasks_processing.go:74] worker 0 stopped. I0429 06:48:48.556732 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 34.052095ms to process 0 records I0429 06:48:48.562351 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (14ms) I0429 06:48:48.572833 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (10ms) I0429 06:48:48.583407 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (11ms) I0429 06:48:48.595161 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (12ms) I0429 06:48:48.606185 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (11ms) I0429 06:48:48.616802 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (11ms) I0429 06:48:48.627426 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (11ms) I0429 06:48:48.637812 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (10ms) I0429 06:48:48.647996 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (10ms) I0429 06:48:48.658567 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (11ms) I0429 06:48:48.669781 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (11ms) I0429 06:48:48.759411 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (90ms) I0429 06:48:48.859463 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0429 06:48:48.959749 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (100ms) I0429 06:48:49.060517 1 gather_workloads_info.go:387] No image sha256:4b748615a43be416d52c33df03e2cdec89ededded1d6a2ade167c5a955d56e5f (101ms) I0429 06:48:49.161914 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (101ms) I0429 06:48:49.260399 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (98ms) I0429 06:48:49.359603 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (99ms) I0429 06:48:49.460234 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (101ms) I0429 06:48:49.559171 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (99ms) I0429 06:48:49.660186 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (101ms) I0429 06:48:49.760482 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (100ms) I0429 06:48:49.860102 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (100ms) I0429 06:48:49.959922 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (100ms) I0429 06:48:50.060305 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (100ms) I0429 06:48:50.159808 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (99ms) I0429 06:48:50.260063 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (100ms) I0429 06:48:50.359765 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0429 06:48:50.461187 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (101ms) I0429 06:48:50.559681 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (98ms) I0429 06:48:50.659918 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0429 06:48:50.759615 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (100ms) I0429 06:48:50.859910 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (100ms) I0429 06:48:50.960337 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms) I0429 06:48:50.960363 1 tasks_processing.go:74] worker 1 stopped. E0429 06:48:50.960373 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0429 06:48:50.960605 1 recorder.go:75] Recording config/workload_info with fingerprint=45f4896135a9d225889ae20a76a71dbf4ccd22367947e278541feb888d134768 I0429 06:48:50.960620 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.43773238s to process 1 records E0429 06:48:50.960642 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.438s with: function \"workload_info\" failed with an error" I0429 06:48:50.961741 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0429 06:48:50.961752 1 periodic.go:216] Running conditional gatherer I0429 06:48:50.970191 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0429 06:48:50.976874 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.8:36399->172.30.0.10:53: read: connection refused E0429 06:48:50.977117 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0429 06:48:50.977172 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0429 06:48:50.984147 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0429 06:48:50.984159 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 06:48:50.984164 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 06:48:50.984167 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 06:48:50.984170 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 06:48:50.984172 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 06:48:50.984175 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 06:48:50.984178 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 06:48:50.984181 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0429 06:48:50.984183 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0429 06:48:50.984197 1 tasks_processing.go:45] number of workers: 3 I0429 06:48:50.984208 1 tasks_processing.go:69] worker 2 listening for tasks. I0429 06:48:50.984212 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0429 06:48:50.984219 1 tasks_processing.go:69] worker 0 listening for tasks. I0429 06:48:50.984232 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0429 06:48:50.984231 1 tasks_processing.go:69] worker 1 listening for tasks. I0429 06:48:50.984237 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0429 06:48:50.984241 1 tasks_processing.go:74] worker 1 stopped. I0429 06:48:50.984288 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0429 06:48:50.984300 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 901ns to process 1 records I0429 06:48:50.984330 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0429 06:48:50.984338 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.225µs to process 1 records I0429 06:48:50.984344 1 tasks_processing.go:74] worker 0 stopped. I0429 06:48:50.984479 1 tasks_processing.go:74] worker 2 stopped. I0429 06:48:50.984492 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 235.046µs to process 0 records I0429 06:48:50.984514 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.8:36399->172.30.0.10:53: read: connection refused I0429 06:48:50.984532 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0429 06:48:51.009655 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=6199394ee1dac55c59b3f12f4d74421067554465343f2f3256ad710bc457a071 I0429 06:48:51.009787 1 diskrecorder.go:70] Writing 103 records to /var/lib/insights-operator/insights-2026-04-29-064851.tar.gz I0429 06:48:51.015819 1 diskrecorder.go:51] Wrote 103 records to disk in 6ms I0429 06:48:51.015845 1 periodic.go:285] Gathering cluster info every 2h0m0s I0429 06:48:51.015861 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0429 06:48:51.292871 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 06:48:51.495650 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 06:48:59.292977 1 configmapobserver.go:84] configmaps "insights-config" not found I0429 06:49:54.627367 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="c5d71bf8e71b29dc9f369be934f172d5d1c1dd4043a03e799fac46336efe4b8d") W0429 06:49:54.627405 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0429 06:49:54.627449 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="372513e6e537fd6e49f2523b12cddaa4004395e7bfed8da4851997c3153492ca") I0429 06:49:54.627474 1 periodic.go:177] Shutting down I0429 06:49:54.627489 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0429 06:49:54.627505 1 base_controller.go:181] Shutting down LoggingSyncer ... I0429 06:49:54.627534 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="7a9c8263bf4a666ec68b3eebf7912e0d0afee8fb0240750eb5694828181f7e13")