W0430 13:45:17.250410 1 cmd.go:257] Using insecure, self-signed certificates I0430 13:45:17.754151 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:45:17.754450 1 observer_polling.go:159] Starting file observer I0430 13:45:18.235647 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0430 13:45:18.235855 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0430 13:45:18.236381 1 secure_serving.go:57] Forcing use of http/1.1 only W0430 13:45:18.236408 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0430 13:45:18.236412 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0430 13:45:18.236416 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0430 13:45:18.236418 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0430 13:45:18.236421 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0430 13:45:18.236423 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0430 13:45:18.236510 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0430 13:45:18.240598 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0430 13:45:18.240613 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c52bbdd4-8da9-4e16-87ee-e20bc29b9ed1", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0430 13:45:18.243372 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0430 13:45:18.243393 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0430 13:45:18.243386 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0430 13:45:18.243408 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0430 13:45:18.243415 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0430 13:45:18.243421 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0430 13:45:18.243707 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2609787952/tls.crt::/tmp/serving-cert-2609787952/tls.key" I0430 13:45:18.244043 1 secure_serving.go:213] Serving securely on [::]:8443 I0430 13:45:18.244073 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0430 13:45:18.250796 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0430 13:45:18.250838 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0430 13:45:18.250914 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0430 13:45:18.257332 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 13:45:18.257352 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0430 13:45:18.263157 1 secretconfigobserver.go:119] support secret does not exist I0430 13:45:18.269159 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0430 13:45:18.275045 1 secretconfigobserver.go:119] support secret does not exist I0430 13:45:18.280876 1 recorder.go:176] Pruning old reports every 7h10m38s, max age is 288h0m0s I0430 13:45:18.287052 1 periodic.go:216] Running clusterconfig gatherer I0430 13:45:18.287057 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0430 13:45:18.287076 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0430 13:45:18.287091 1 tasks_processing.go:45] number of workers: 64 I0430 13:45:18.287106 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0430 13:45:18.287113 1 insightsreport.go:296] Starting report retriever I0430 13:45:18.287120 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0430 13:45:18.287115 1 tasks_processing.go:69] worker 4 listening for tasks. I0430 13:45:18.287130 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:45:18.287139 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:45:18.287139 1 tasks_processing.go:69] worker 12 listening for tasks. I0430 13:45:18.287144 1 tasks_processing.go:71] worker 1 working on certificate_signing_requests task. I0430 13:45:18.287145 1 tasks_processing.go:69] worker 10 listening for tasks. I0430 13:45:18.287138 1 tasks_processing.go:69] worker 11 listening for tasks. I0430 13:45:18.287151 1 tasks_processing.go:69] worker 15 listening for tasks. I0430 13:45:18.287142 1 tasks_processing.go:71] worker 0 working on monitoring_persistent_volumes task. I0430 13:45:18.287164 1 tasks_processing.go:69] worker 8 listening for tasks. I0430 13:45:18.287137 1 tasks_processing.go:69] worker 14 listening for tasks. I0430 13:45:18.287169 1 tasks_processing.go:69] worker 2 listening for tasks. I0430 13:45:18.287171 1 tasks_processing.go:69] worker 6 listening for tasks. I0430 13:45:18.287155 1 tasks_processing.go:69] worker 13 listening for tasks. I0430 13:45:18.287157 1 tasks_processing.go:69] worker 5 listening for tasks. I0430 13:45:18.287185 1 tasks_processing.go:69] worker 39 listening for tasks. I0430 13:45:18.287162 1 tasks_processing.go:69] worker 7 listening for tasks. I0430 13:45:18.287165 1 tasks_processing.go:69] worker 16 listening for tasks. I0430 13:45:18.287171 1 tasks_processing.go:69] worker 17 listening for tasks. I0430 13:45:18.287195 1 tasks_processing.go:69] worker 33 listening for tasks. I0430 13:45:18.287198 1 tasks_processing.go:69] worker 35 listening for tasks. I0430 13:45:18.287170 1 tasks_processing.go:69] worker 3 listening for tasks. I0430 13:45:18.287149 1 tasks_processing.go:69] worker 9 listening for tasks. I0430 13:45:18.287206 1 tasks_processing.go:69] worker 36 listening for tasks. I0430 13:45:18.287176 1 tasks_processing.go:69] worker 29 listening for tasks. I0430 13:45:18.287211 1 tasks_processing.go:69] worker 24 listening for tasks. I0430 13:45:18.287210 1 tasks_processing.go:69] worker 23 listening for tasks. I0430 13:45:18.287216 1 tasks_processing.go:69] worker 47 listening for tasks. I0430 13:45:18.287216 1 tasks_processing.go:69] worker 20 listening for tasks. I0430 13:45:18.287210 1 tasks_processing.go:69] worker 32 listening for tasks. I0430 13:45:18.287226 1 tasks_processing.go:69] worker 55 listening for tasks. I0430 13:45:18.287227 1 tasks_processing.go:69] worker 21 listening for tasks. I0430 13:45:18.287177 1 tasks_processing.go:69] worker 34 listening for tasks. I0430 13:45:18.287231 1 tasks_processing.go:69] worker 46 listening for tasks. I0430 13:45:18.287236 1 tasks_processing.go:69] worker 54 listening for tasks. I0430 13:45:18.287237 1 tasks_processing.go:69] worker 44 listening for tasks. I0430 13:45:18.287226 1 tasks_processing.go:69] worker 50 listening for tasks. I0430 13:45:18.287244 1 tasks_processing.go:69] worker 59 listening for tasks. I0430 13:45:18.287244 1 tasks_processing.go:69] worker 57 listening for tasks. I0430 13:45:18.287179 1 tasks_processing.go:69] worker 37 listening for tasks. I0430 13:45:18.287250 1 tasks_processing.go:69] worker 61 listening for tasks. I0430 13:45:18.287160 1 tasks_processing.go:69] worker 40 listening for tasks. I0430 13:45:18.287189 1 tasks_processing.go:69] worker 30 listening for tasks. I0430 13:45:18.287190 1 tasks_processing.go:69] worker 22 listening for tasks. I0430 13:45:18.287194 1 tasks_processing.go:69] worker 52 listening for tasks. I0430 13:45:18.287193 1 tasks_processing.go:69] worker 28 listening for tasks. I0430 13:45:18.287197 1 tasks_processing.go:69] worker 18 listening for tasks. I0430 13:45:18.287204 1 tasks_processing.go:69] worker 25 listening for tasks. I0430 13:45:18.287202 1 tasks_processing.go:69] worker 41 listening for tasks. I0430 13:45:18.287205 1 tasks_processing.go:69] worker 26 listening for tasks. I0430 13:45:18.287207 1 tasks_processing.go:69] worker 19 listening for tasks. I0430 13:45:18.287213 1 tasks_processing.go:69] worker 42 listening for tasks. I0430 13:45:18.287213 1 tasks_processing.go:69] worker 27 listening for tasks. I0430 13:45:18.287218 1 tasks_processing.go:69] worker 31 listening for tasks. I0430 13:45:18.287221 1 tasks_processing.go:69] worker 48 listening for tasks. I0430 13:45:18.287223 1 tasks_processing.go:69] worker 43 listening for tasks. I0430 13:45:18.287226 1 tasks_processing.go:69] worker 45 listening for tasks. I0430 13:45:18.287232 1 tasks_processing.go:69] worker 53 listening for tasks. I0430 13:45:18.287231 1 tasks_processing.go:69] worker 51 listening for tasks. I0430 13:45:18.287233 1 tasks_processing.go:69] worker 49 listening for tasks. I0430 13:45:18.287235 1 tasks_processing.go:69] worker 56 listening for tasks. I0430 13:45:18.287244 1 tasks_processing.go:71] worker 4 working on openstack_controlplanes task. I0430 13:45:18.287318 1 tasks_processing.go:71] worker 12 working on image_pruners task. I0430 13:45:18.287327 1 tasks_processing.go:71] worker 10 working on machine_configs task. I0430 13:45:18.287327 1 tasks_processing.go:71] worker 5 working on machine_healthchecks task. I0430 13:45:18.287338 1 tasks_processing.go:71] worker 39 working on openshift_logging task. I0430 13:45:18.287244 1 tasks_processing.go:69] worker 62 listening for tasks. I0430 13:45:18.287388 1 tasks_processing.go:71] worker 62 working on olm_operators task. I0430 13:45:18.287390 1 tasks_processing.go:71] worker 59 working on clusterroles task. I0430 13:45:18.287404 1 tasks_processing.go:71] worker 11 working on infrastructures task. I0430 13:45:18.287410 1 tasks_processing.go:71] worker 57 working on lokistack task. I0430 13:45:18.287418 1 tasks_processing.go:71] worker 2 working on authentication task. I0430 13:45:18.287434 1 tasks_processing.go:71] worker 26 working on jaegers task. I0430 13:45:18.287457 1 tasks_processing.go:71] worker 7 working on networks task. I0430 13:45:18.287463 1 tasks_processing.go:71] worker 42 working on ingress task. I0430 13:45:18.287244 1 tasks_processing.go:69] worker 60 listening for tasks. I0430 13:45:18.287238 1 tasks_processing.go:69] worker 58 listening for tasks. I0430 13:45:18.287247 1 tasks_processing.go:69] worker 63 listening for tasks. I0430 13:45:18.287181 1 tasks_processing.go:69] worker 38 listening for tasks. I0430 13:45:18.287465 1 tasks_processing.go:71] worker 14 working on oauths task. I0430 13:45:18.287487 1 tasks_processing.go:71] worker 35 working on node_logs task. I0430 13:45:18.287485 1 tasks_processing.go:71] worker 23 working on openshift_machine_api_events task. I0430 13:45:18.287459 1 tasks_processing.go:71] worker 19 working on active_alerts task. I0430 13:45:18.287518 1 tasks_processing.go:71] worker 15 working on qemu_kubevirt_launcher_logs task. I0430 13:45:18.287527 1 tasks_processing.go:71] worker 21 working on node_features task. W0430 13:45:18.287524 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:45:18.287543 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 28.841µs to process 0 records I0430 13:45:18.287549 1 tasks_processing.go:71] worker 6 working on silenced_alerts task. I0430 13:45:18.287553 1 tasks_processing.go:71] worker 34 working on cost_management_metrics_configs task. I0430 13:45:18.287472 1 tasks_processing.go:71] worker 3 working on nodenetworkconfigurationpolicies task. I0430 13:45:18.287646 1 tasks_processing.go:71] worker 53 working on tsdb_status task. I0430 13:45:18.287700 1 tasks_processing.go:71] worker 37 working on overlapping_namespace_uids task. I0430 13:45:18.287730 1 tasks_processing.go:71] worker 41 working on operators_pods_and_events task. I0430 13:45:18.287322 1 tasks_processing.go:71] worker 8 working on sap_pods task. I0430 13:45:18.287648 1 tasks_processing.go:71] worker 51 working on config_maps task. I0430 13:45:18.287701 1 tasks_processing.go:71] worker 30 working on openstack_dataplanedeployments task. I0430 13:45:18.287333 1 tasks_processing.go:71] worker 56 working on crds task. I0430 13:45:18.287480 1 tasks_processing.go:71] worker 17 working on machine_sets task. I0430 13:45:18.287484 1 tasks_processing.go:71] worker 33 working on storage_cluster task. W0430 13:45:18.287569 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:45:18.288182 1 tasks_processing.go:71] worker 6 working on validating_webhook_configurations task. I0430 13:45:18.287581 1 tasks_processing.go:71] worker 13 working on mutating_webhook_configurations task. I0430 13:45:18.288281 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 622.132µs to process 0 records I0430 13:45:18.287588 1 tasks_processing.go:71] worker 20 working on machine_autoscalers task. I0430 13:45:18.288368 1 tasks_processing.go:71] worker 25 working on support_secret task. I0430 13:45:18.287593 1 tasks_processing.go:71] worker 47 working on nodes task. I0430 13:45:18.287600 1 tasks_processing.go:71] worker 44 working on schedulers task. I0430 13:45:18.287601 1 tasks_processing.go:71] worker 19 working on proxies task. I0430 13:45:18.287603 1 tasks_processing.go:71] worker 46 working on ingress_certificates task. I0430 13:45:18.287607 1 tasks_processing.go:71] worker 54 working on machine_config_pools task. I0430 13:45:18.287612 1 tasks_processing.go:71] worker 36 working on cluster_apiserver task. I0430 13:45:18.287616 1 tasks_processing.go:71] worker 9 working on pod_network_connectivity_checks task. I0430 13:45:18.287621 1 tasks_processing.go:71] worker 29 working on dvo_metrics task. I0430 13:45:18.287626 1 tasks_processing.go:71] worker 50 working on aggregated_monitoring_cr_names task. I0430 13:45:18.287632 1 tasks_processing.go:71] worker 43 working on openstack_version task. I0430 13:45:18.287635 1 tasks_processing.go:71] worker 27 working on version task. I0430 13:45:18.287638 1 tasks_processing.go:71] worker 31 working on machines task. I0430 13:45:18.287640 1 tasks_processing.go:71] worker 48 working on pdbs task. I0430 13:45:18.287652 1 tasks_processing.go:71] worker 49 working on container_images task. I0430 13:45:18.287659 1 tasks_processing.go:71] worker 24 working on sap_datahubs task. I0430 13:45:18.287666 1 tasks_processing.go:71] worker 32 working on openstack_dataplanenodesets task. I0430 13:45:18.287674 1 tasks_processing.go:71] worker 55 working on metrics task. I0430 13:45:18.287680 1 tasks_processing.go:71] worker 45 working on nodenetworkstates task. I0430 13:45:18.287682 1 tasks_processing.go:71] worker 58 working on ceph_cluster task. I0430 13:45:18.287686 1 tasks_processing.go:71] worker 63 working on service_accounts task. I0430 13:45:18.287685 1 tasks_processing.go:71] worker 60 working on sap_config task. I0430 13:45:18.287476 1 tasks_processing.go:71] worker 16 working on operators task. I0430 13:45:18.287691 1 tasks_processing.go:71] worker 22 working on image task. I0430 13:45:18.287694 1 tasks_processing.go:71] worker 61 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0430 13:45:18.287696 1 tasks_processing.go:71] worker 40 working on feature_gates task. I0430 13:45:18.290749 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 3.41772ms to process 0 records I0430 13:45:18.287710 1 tasks_processing.go:71] worker 38 working on container_runtime_configs task. I0430 13:45:18.287716 1 tasks_processing.go:71] worker 18 working on install_plans task. I0430 13:45:18.287720 1 tasks_processing.go:71] worker 52 working on image_registries task. W0430 13:45:18.287719 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:45:18.287724 1 tasks_processing.go:71] worker 28 working on storage_classes task. W0430 13:45:18.290099 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:45:18.290968 1 tasks_processing.go:74] worker 55 stopped. I0430 13:45:18.290725 1 tasks_processing.go:74] worker 4 stopped. I0430 13:45:18.290982 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 888.483µs to process 0 records I0430 13:45:18.290994 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 3.264196ms to process 0 records I0430 13:45:18.291048 1 tasks_processing.go:74] worker 53 stopped. I0430 13:45:18.292263 1 tasks_processing.go:74] worker 5 stopped. E0430 13:45:18.292276 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0430 13:45:18.292284 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 4.916218ms to process 0 records I0430 13:45:18.314163 1 tasks_processing.go:74] worker 39 stopped. I0430 13:45:18.314210 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 26.809825ms to process 0 records I0430 13:45:18.314234 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 26.772599ms to process 0 records E0430 13:45:18.314232 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0430 13:45:18.314241 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 26.172145ms to process 0 records I0430 13:45:18.314247 1 tasks_processing.go:74] worker 17 stopped. I0430 13:45:18.314250 1 tasks_processing.go:74] worker 26 stopped. E0430 13:45:18.314257 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0430 13:45:18.314269 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 25.430926ms to process 0 records I0430 13:45:18.314279 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 26.713043ms to process 0 records I0430 13:45:18.314285 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 26.299903ms to process 0 records I0430 13:45:18.314292 1 tasks_processing.go:74] worker 30 stopped. I0430 13:45:18.314296 1 tasks_processing.go:74] worker 21 stopped. I0430 13:45:18.314296 1 tasks_processing.go:74] worker 9 stopped. I0430 13:45:18.314328 1 tasks_processing.go:74] worker 43 stopped. I0430 13:45:18.314334 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 24.941225ms to process 0 records E0430 13:45:18.314341 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0430 13:45:18.314350 1 gather.go:177] gatherer "clusterconfig" function "machines" took 24.815505ms to process 0 records I0430 13:45:18.314357 1 tasks_processing.go:74] worker 31 stopped. I0430 13:45:18.314488 1 tasks_processing.go:74] worker 24 stopped. I0430 13:45:18.314501 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 24.678625ms to process 0 records I0430 13:45:18.314510 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 27.079594ms to process 0 records I0430 13:45:18.314515 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 26.940989ms to process 0 records I0430 13:45:18.314519 1 tasks_processing.go:74] worker 57 stopped. I0430 13:45:18.314521 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 26.853436ms to process 0 records I0430 13:45:18.314529 1 tasks_processing.go:74] worker 34 stopped. I0430 13:45:18.314533 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 24.575639ms to process 0 records I0430 13:45:18.314541 1 tasks_processing.go:74] worker 32 stopped. I0430 13:45:18.314526 1 tasks_processing.go:74] worker 3 stopped. I0430 13:45:18.314643 1 tasks_processing.go:74] worker 33 stopped. I0430 13:45:18.314652 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 26.543116ms to process 0 records I0430 13:45:18.314667 1 tasks_processing.go:74] worker 54 stopped. I0430 13:45:18.314672 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 25.949459ms to process 0 records I0430 13:45:18.314684 1 tasks_processing.go:74] worker 0 stopped. I0430 13:45:18.314701 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 27.512664ms to process 0 records I0430 13:45:18.314839 1 tasks_processing.go:74] worker 48 stopped. I0430 13:45:18.314855 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0430 13:45:18.314873 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0430 13:45:18.314878 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0430 13:45:18.314883 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0430 13:45:18.314904 1 controller.go:531] The operator is still being initialized I0430 13:45:18.314914 1 controller.go:554] The operator is healthy I0430 13:45:18.315025 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=5c46bbf96f646245054f0cc174b0acfdf3455877d90bfba29fd9e64c57c4867d I0430 13:45:18.315064 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=14a5720b85aa3e5d375130fd1d4ad5e5db22069a70ad9fc7dfc7bf17be8794e4 I0430 13:45:18.315093 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=d5472bd31903b8f63b863485432196712a74a31fac404405385e2210e02ead48 I0430 13:45:18.315107 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 25.226253ms to process 3 records I0430 13:45:18.315187 1 recorder.go:75] Recording config/image with fingerprint=af3d2d768dc0a4e55c7d9472f6247e5ec4724947b27c2c84809196f3c613ac94 I0430 13:45:18.315199 1 gather.go:177] gatherer "clusterconfig" function "image" took 24.243211ms to process 1 records I0430 13:45:18.315222 1 tasks_processing.go:74] worker 22 stopped. I0430 13:45:18.315289 1 tasks_processing.go:74] worker 7 stopped. I0430 13:45:18.315402 1 recorder.go:75] Recording config/network with fingerprint=be75837ceac88f8d847caa28c01e0d88372e025937ade25c94b67a97c2806577 I0430 13:45:18.315415 1 gather.go:177] gatherer "clusterconfig" function "networks" took 27.417208ms to process 1 records I0430 13:45:18.315476 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=23ee21a7b8f8456227d0f8217d24b2d1e580b1f4160d4fdcd0df22dfb0f02d73 I0430 13:45:18.315487 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 26.424848ms to process 1 records I0430 13:45:18.315495 1 tasks_processing.go:74] worker 44 stopped. I0430 13:45:18.315538 1 recorder.go:75] Recording config/proxy with fingerprint=6c793417f61cbf2c733650bf306dcd25475b0abc8bba384ceb7bd5082bfcb6af I0430 13:45:18.315549 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 26.372981ms to process 1 records I0430 13:45:18.315556 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 27.643101ms to process 0 records I0430 13:45:18.315563 1 tasks_processing.go:74] worker 19 stopped. I0430 13:45:18.315564 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 24.600554ms to process 0 records I0430 13:45:18.315571 1 tasks_processing.go:74] worker 60 stopped. I0430 13:45:18.315574 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 26.903621ms to process 0 records I0430 13:45:18.315580 1 tasks_processing.go:74] worker 62 stopped. I0430 13:45:18.315580 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 27.497508ms to process 0 records I0430 13:45:18.315587 1 tasks_processing.go:74] worker 20 stopped. I0430 13:45:18.315584 1 tasks_processing.go:74] worker 8 stopped. I0430 13:45:18.315671 1 tasks_processing.go:74] worker 14 stopped. I0430 13:45:18.315908 1 recorder.go:75] Recording config/oauth with fingerprint=3bba79c15d1e8d7c50cd452a959b224e71395a86c76530fba4d75e027ab59ee1 I0430 13:45:18.315922 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 28.170729ms to process 1 records I0430 13:45:18.320756 1 tasks_processing.go:74] worker 25 stopped. E0430 13:45:18.320774 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0430 13:45:18.320785 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 32.355311ms to process 0 records I0430 13:45:18.321090 1 tasks_processing.go:74] worker 2 stopped. I0430 13:45:18.321282 1 recorder.go:75] Recording config/authentication with fingerprint=518a4a925478165e5e70b299f81897f86f29afc76bfb13a031006c2a630b8ca3 I0430 13:45:18.321299 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 33.663312ms to process 1 records I0430 13:45:18.321397 1 tasks_processing.go:74] worker 11 stopped. I0430 13:45:18.321486 1 gather_logs.go:145] no pods in namespace were found I0430 13:45:18.321730 1 recorder.go:75] Recording config/infrastructure with fingerprint=16cef1779248427df690993da76ddf01068c18f7b96de5856ab476bc495e74f4 I0430 13:45:18.321739 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 33.712896ms to process 1 records I0430 13:45:18.321749 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 31.036232ms to process 0 records E0430 13:45:18.321754 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0430 13:45:18.321758 1 tasks_processing.go:74] worker 58 stopped. I0430 13:45:18.321766 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0430 13:45:18.321772 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 33.898246ms to process 1 records I0430 13:45:18.321827 1 tasks_processing.go:74] worker 10 stopped. I0430 13:45:18.321875 1 recorder.go:75] Recording config/ingress with fingerprint=8a9c35c0a4b5a827a5b556768d3dc5e6356846f93b0899f1ec2a2ab9e5030461 I0430 13:45:18.321883 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 33.913229ms to process 1 records I0430 13:45:18.321885 1 tasks_processing.go:74] worker 42 stopped. I0430 13:45:18.321950 1 tasks_processing.go:74] worker 36 stopped. I0430 13:45:18.321975 1 recorder.go:75] Recording config/apiserver with fingerprint=1882d548135d920a0c9217397edcd8caace2caec4654ec312dd74fd779498c68 I0430 13:45:18.321983 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 32.649459ms to process 1 records I0430 13:45:18.321991 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 31.323545ms to process 0 records I0430 13:45:18.321996 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 33.967108ms to process 0 records I0430 13:45:18.322001 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 30.650104ms to process 0 records I0430 13:45:18.322003 1 tasks_processing.go:74] worker 45 stopped. I0430 13:45:18.322005 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 34.120508ms to process 0 records I0430 13:45:18.322008 1 tasks_processing.go:74] worker 15 stopped. I0430 13:45:18.322011 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 34.167627ms to process 0 records I0430 13:45:18.322012 1 tasks_processing.go:74] worker 38 stopped. I0430 13:45:18.322017 1 tasks_processing.go:74] worker 23 stopped. I0430 13:45:18.322018 1 tasks_processing.go:74] worker 35 stopped. I0430 13:45:18.322487 1 tasks_processing.go:74] worker 13 stopped. I0430 13:45:18.322646 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7512875939c1c960ba49f72c26c63e4625667e13a41bfb4df8eb1bdd0125aa6e I0430 13:45:18.322684 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=16d55ba22ea6c598ff0f9be97e656ecbc8a60e6ca919686c3ce23c2ad0b115d6 I0430 13:45:18.322725 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=a56c71e8d73340e120fe760fc72f19756e1f6fbddb6ff12f48713d4561dcd461 I0430 13:45:18.322737 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 34.222179ms to process 3 records I0430 13:45:18.322767 1 tasks_processing.go:74] worker 40 stopped. I0430 13:45:18.323421 1 recorder.go:75] Recording config/featuregate with fingerprint=e00610c44129ff64dec6f3f4ab8e08d19e745e7ac90568157adafc73cc19bdde I0430 13:45:18.323541 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 32.013874ms to process 1 records I0430 13:45:18.323677 1 tasks_processing.go:74] worker 6 stopped. I0430 13:45:18.323777 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=b6e453c1d3d17436fe8c4f44085d12235362e44a3e1a59413f39e93f3ca16215 I0430 13:45:18.324166 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=cac92b0095ea8b3b006523d6e733cf16f673e2a3b64a98a5df5774d3cc9c15ad I0430 13:45:18.324303 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=973acfabf82e2005901e19eca7a1133597cd032245206da752f236295dfe12cc I0430 13:45:18.324385 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=cca543d91bb11c1a3145cfaea5e33985fb04330b5d0497d6d0f3c30da10810c4 I0430 13:45:18.324460 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=5998c16b0ce24462bdc086e774ed00bf3def539cc02350e50edd852bc889067a I0430 13:45:18.324539 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=f1a60f67fd4d67bdd5e38572c4878b5038d38f54e457292353db9a1c5a34beab I0430 13:45:18.325850 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=fde3143b4cc4bb6aa6f8c5460800c9ee62228e8bf8ff24b49d48a1d2ba7ba2a7 I0430 13:45:18.325919 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=2ec39995688f3ea3eeff89b7397ab2a79b10902f52586e08acce42b7a9c97b81 I0430 13:45:18.325952 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=990ec175e22bc5095407b70223b834469f710fa649caa6c51f25b45d629d9f6f I0430 13:45:18.325982 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=c85b2b988f35cab89b2f77992e59e47c24849ec165f8fc31f77b978406b1b1c9 I0430 13:45:18.326021 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=44654a1a0399eb3092571c9ff87ee82b8a4e1e87498f70006b36a5f402e82bdb I0430 13:45:18.326036 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 34.641249ms to process 11 records I0430 13:45:18.326060 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0430 13:45:18.326078 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 36.425372ms to process 1 records I0430 13:45:18.326087 1 tasks_processing.go:74] worker 37 stopped. I0430 13:45:18.326271 1 tasks_processing.go:74] worker 47 stopped. I0430 13:45:18.326685 1 recorder.go:75] Recording config/node/ip-10-0-0-154.ec2.internal with fingerprint=1223a6ebfa2db4a406161ac0d94de76a180e7cabe78af2513584babb0f1015a4 I0430 13:45:18.326774 1 recorder.go:75] Recording config/node/ip-10-0-1-226.ec2.internal with fingerprint=a87ca8769d04daf97f8ac4f43020f33804052526f747f26f62ecee0db4f2aae1 I0430 13:45:18.326871 1 recorder.go:75] Recording config/node/ip-10-0-2-151.ec2.internal with fingerprint=98a3d1c28f7e1713452c2137bb272f5546ec8873debabcfdba094e19e41c6f96 I0430 13:45:18.326885 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 37.837432ms to process 3 records I0430 13:45:18.326971 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=68eb455bc490d532ff93aaeb13452e38f289baba2c5ce88b567ee9fa7ed1aaa5 I0430 13:45:18.326990 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=76787cbbe22219c7db706568a105ff2312c9f135701b10736b772e4b794dacc0 I0430 13:45:18.326998 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 35.606951ms to process 2 records I0430 13:45:18.327006 1 tasks_processing.go:74] worker 28 stopped. I0430 13:45:18.327363 1 tasks_processing.go:74] worker 1 stopped. I0430 13:45:18.327381 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 40.210472ms to process 0 records I0430 13:45:18.327496 1 tasks_processing.go:74] worker 52 stopped. I0430 13:45:18.328015 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=e7c9dbca0ae5fc6156e15cb53b71c2899d03c40eab678560c19217fba6c29035 I0430 13:45:18.328035 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 36.421393ms to process 1 records W0430 13:45:18.331240 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:45:18.334361 1 tasks_processing.go:74] worker 49 stopped. I0430 13:45:18.334430 1 recorder.go:75] Recording config/running_containers with fingerprint=d8e6a78720df6430a5ab55a2f5d2bbec5e2fd91c3a8de321d143f0e6f4f64438 I0430 13:45:18.334444 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 44.567147ms to process 1 records I0430 13:45:18.336765 1 tasks_processing.go:74] worker 12 stopped. I0430 13:45:18.336892 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=d384381c52af40edb622acb56534b45b65b21f0d196d8b54f47fa535afb5d21a I0430 13:45:18.336907 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 49.431803ms to process 1 records I0430 13:45:18.342182 1 tasks_processing.go:74] worker 56 stopped. I0430 13:45:18.343663 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=df91d22c6e56605b14d63725d62b71bfdcabcbd466cd85d54cb33419693f430a I0430 13:45:18.343737 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0430 13:45:18.343724 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0430 13:45:18.343737 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0430 13:45:18.344261 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=f1e06cb23051db05af71ea83ad6a063dbfe4a841d5cf88f3a3d0f7e4b7b114c7 I0430 13:45:18.344572 1 gather.go:177] gatherer "clusterconfig" function "crds" took 54.156595ms to process 2 records I0430 13:45:18.344580 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 53.796036ms to process 0 records I0430 13:45:18.344603 1 tasks_processing.go:74] worker 50 stopped. I0430 13:45:18.344667 1 tasks_processing.go:74] worker 27 stopped. I0430 13:45:18.344786 1 recorder.go:75] Recording config/version with fingerprint=953f130b13c1ed5409bcbf20df88ec6bbf46d0f7bdda24bd18ce10a043368f63 I0430 13:45:18.344797 1 recorder.go:75] Recording config/id with fingerprint=dc1412ece7035d5433a19e43b0746e6dc075775275b62db264b0b0294d245ae8 I0430 13:45:18.344801 1 gather.go:177] gatherer "clusterconfig" function "version" took 53.561884ms to process 2 records I0430 13:45:18.344901 1 tasks_processing.go:74] worker 59 stopped. I0430 13:45:18.344919 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0430 13:45:18.344968 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b5ff58e668a79eabbab894bcd0b931f85b31804276e96b6a71ce096b3ff6ebc7 I0430 13:45:18.344989 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0430 13:45:18.345041 1 operator.go:328] started I0430 13:45:18.345057 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0430 13:45:18.345075 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=5275f6d6e36be1007207f32f9bed1a2ff0ea6724e7388f3891a3f4b854530a16 I0430 13:45:18.345086 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 55.953805ms to process 2 records I0430 13:45:18.351011 1 base_controller.go:82] Caches are synced for ConfigController I0430 13:45:18.351031 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0430 13:45:18.369324 1 tasks_processing.go:74] worker 61 stopped. I0430 13:45:18.369349 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 78.597146ms to process 0 records I0430 13:45:18.372522 1 controller.go:254] Source scaController *sca.Controller is not ready I0430 13:45:18.372535 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0430 13:45:18.372542 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0430 13:45:18.372545 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0430 13:45:18.372549 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0430 13:45:18.372571 1 controller.go:531] The operator is still being initialized I0430 13:45:18.372578 1 controller.go:554] The operator is healthy E0430 13:45:18.379125 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27228ff225-387e-4cd9-af70-639ee27d0bc2%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.15:32877->172.30.0.10:53: read: connection refused I0430 13:45:18.379140 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27228ff225-387e-4cd9-af70-639ee27d0bc2%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.15:32877->172.30.0.10:53: read: connection refused I0430 13:45:18.399563 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:45:18.399743 1 prometheus_rules.go:88] Prometheus rules successfully created I0430 13:45:18.400182 1 tasks_processing.go:74] worker 51 stopped. E0430 13:45:18.400199 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0430 13:45:18.400210 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0430 13:45:18.400215 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0430 13:45:18.400240 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0430 13:45:18.400298 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0430 13:45:18.400308 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0430 13:45:18.400316 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0430 13:45:18.400322 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0430 13:45:18.400384 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0430 13:45:18.400396 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0430 13:45:18.400405 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 112.267981ms to process 7 records I0430 13:45:18.438768 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0430 13:45:18.442993 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.15:35309->172.30.0.10:53: read: connection refused I0430 13:45:18.443012 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.15:35309->172.30.0.10:53: read: connection refused I0430 13:45:18.446077 1 base_controller.go:82] Caches are synced for LoggingSyncer I0430 13:45:18.446090 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0430 13:45:18.448002 1 tasks_processing.go:74] worker 46 stopped. E0430 13:45:18.448020 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0430 13:45:18.448026 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q0gm1et81s43r87q198pohg8h0ddqcp-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q0gm1et81s43r87q198pohg8h0ddqcp-primary-cert-bundle-secret" not found I0430 13:45:18.448102 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=d3901d7ff943867d2b03d805958272d55bcac6cd4dfd646bffd75820f87864c0 I0430 13:45:18.448118 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 159.304417ms to process 1 records I0430 13:45:18.466863 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0430 13:45:18.473114 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0430 13:45:18.736690 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0430 13:45:18.736705 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0430 13:45:18.737465 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-kj6gq pod in namespace openshift-dns (previous: false). I0430 13:45:18.958437 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-kj6gq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-kj6gq\" is waiting to start: ContainerCreating" I0430 13:45:18.958457 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-kj6gq\" is waiting to start: ContainerCreating" I0430 13:45:18.958465 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-kj6gq pod in namespace openshift-dns (previous: false). I0430 13:45:19.143979 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-kj6gq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-kj6gq\" is waiting to start: ContainerCreating" I0430 13:45:19.143999 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-kj6gq\" is waiting to start: ContainerCreating" I0430 13:45:19.144011 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-mnd9k pod in namespace openshift-dns (previous: false). W0430 13:45:19.329622 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:45:19.383929 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mnd9k pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-mnd9k\" is waiting to start: ContainerCreating" I0430 13:45:19.383949 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-mnd9k\" is waiting to start: ContainerCreating" I0430 13:45:19.383959 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-mnd9k pod in namespace openshift-dns (previous: false). I0430 13:45:19.547271 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mnd9k pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-mnd9k\" is waiting to start: ContainerCreating" I0430 13:45:19.547293 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-mnd9k\" is waiting to start: ContainerCreating" I0430 13:45:19.547308 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vtrxb pod in namespace openshift-dns (previous: false). I0430 13:45:19.761253 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vtrxb pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vtrxb\" is waiting to start: ContainerCreating" I0430 13:45:19.761274 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vtrxb\" is waiting to start: ContainerCreating" I0430 13:45:19.761283 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vtrxb pod in namespace openshift-dns (previous: false). I0430 13:45:19.781462 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0430 13:45:19.944891 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vtrxb pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vtrxb\" is waiting to start: ContainerCreating" I0430 13:45:19.944911 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vtrxb\" is waiting to start: ContainerCreating" I0430 13:45:19.944924 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-98mnv pod in namespace openshift-dns (previous: false). I0430 13:45:20.144286 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:45:20.144307 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-rlr7l pod in namespace openshift-dns (previous: false). I0430 13:45:20.164918 1 tasks_processing.go:74] worker 16 stopped. I0430 13:45:20.164979 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=65a7191ba611724f080e4a1bdc4154ee2a97c5a8d77b88658e4153a2a83d8ff2 I0430 13:45:20.165034 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=28d7f86ab1fc0aa4e53c8e63eb4834484560bf3aa7b6c410706b0df3f523e17d I0430 13:45:20.165073 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0430 13:45:20.165109 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=6643763f9363ee77669aadc975b4fd663b443336b7b71e8a641b9aa141c8888f I0430 13:45:20.165135 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0430 13:45:20.165169 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=c0ee7f5020953cf4715850d45cea7047648efc86db9c104bc374d86d8f539743 I0430 13:45:20.165221 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=bcf8cb9a31494890cc12b5b8164b96c0c19cbacd6ff6a9491e11177a0087a46c I0430 13:45:20.165255 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=fb765ead6fd1ca88479a3745e2492e9532cab63c82f61cba75361ee210c7fe0c I0430 13:45:20.165279 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=3c039addb3feaba1cc64b014c0390f016d386968c431b397ee6d209b8eeb6d47 I0430 13:45:20.165308 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=07bc90e3fe5f1229c78b9e1ad27672a4283395320cae0a5fc8541d19e4381408 I0430 13:45:20.165322 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0430 13:45:20.165347 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=dad257a56685182a4a1c89acb5c6a97bef13ed5e21399c65e1c8aa30fdaefe39 I0430 13:45:20.165362 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0430 13:45:20.165391 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=3c08e19e125ad67ae6b99aa99e13aac6d7166761c29dda2f40a7122491738364 I0430 13:45:20.165406 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0430 13:45:20.165428 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=ede0b0c1a5c9e4248e0d1e40235bdb15fbd942cacf83aa491ac47883cb86c2ba I0430 13:45:20.165441 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0430 13:45:20.165466 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=c67cd517fe9320d23e3d44b28307fadc1e663f3d727f9469a339647d7c8f4306 I0430 13:45:20.165632 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=7388437c2dadd8d754174261babe39090ab352f8d62aec98301bb01bff03cdc9 I0430 13:45:20.165647 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0430 13:45:20.165660 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0430 13:45:20.165691 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0430 13:45:20.165725 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=eddff8659b9c48bf67ee801deddab8a299033fa402a8c19e5a728bb201af7b50 I0430 13:45:20.165764 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=64df37e70f566fcfc756c236c1662e0d689e8ab68191b7c042711e8b17af99b8 I0430 13:45:20.165778 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0430 13:45:20.165803 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=8abaf78382081edc7155c6fcb7e481874d046b1017ad1fab04bc9050c7405c06 I0430 13:45:20.165831 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0430 13:45:20.165855 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=354b7e8ca678956c1b6af2d8645ce88a453b95308ad4f7754e65d7445c25cfd3 I0430 13:45:20.165878 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=9e015784380e13cc7539091651042cdf6a494337ed37a7862335bd7e1ed2499e I0430 13:45:20.165902 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=4339d168d46a3f7b48601def715ca67d9f822458d7050c1e77778f31f32f761b I0430 13:45:20.165927 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=951e7edc545d4dff188c2d86639a68bf7816b97ed5adc31b2dd9aad4146a3dbe I0430 13:45:20.165948 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=8b17d6b220775da290e4bf423a136f582b08131691e2419497b3d3f3e16ce15b I0430 13:45:20.165989 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=7b24c3fbe83f63421bc8118f2ad69537f19751b4d1226f464bcb47e4b0ef0ec4 I0430 13:45:20.166016 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0430 13:45:20.166031 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0430 13:45:20.166042 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.874332618s to process 35 records W0430 13:45:20.330287 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:45:20.343748 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:45:20.343764 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-t7bxp pod in namespace openshift-dns (previous: false). I0430 13:45:20.544595 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:45:20.544617 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-86dd7c6776-9gffl pod in namespace openshift-image-registry (previous: false). I0430 13:45:20.747551 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-86dd7c6776-9gffl pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-86dd7c6776-9gffl\" is waiting to start: ContainerCreating" I0430 13:45:20.747573 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-86dd7c6776-9gffl\" is waiting to start: ContainerCreating" I0430 13:45:20.747583 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-86dd7c6776-cxczx pod in namespace openshift-image-registry (previous: false). I0430 13:45:20.944883 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-86dd7c6776-cxczx pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-86dd7c6776-cxczx\" is waiting to start: ContainerCreating" I0430 13:45:20.944908 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-86dd7c6776-cxczx\" is waiting to start: ContainerCreating" I0430 13:45:20.944919 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-b6f9d6867-w8x98 pod in namespace openshift-image-registry (previous: false). I0430 13:45:21.143125 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-b6f9d6867-w8x98 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-b6f9d6867-w8x98\" is waiting to start: ContainerCreating" I0430 13:45:21.143143 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-b6f9d6867-w8x98\" is waiting to start: ContainerCreating" I0430 13:45:21.143155 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-j9xv2 pod in namespace openshift-image-registry (previous: false). W0430 13:45:21.330030 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:45:21.343649 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:45:21.343673 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-jdcc4 pod in namespace openshift-image-registry (previous: false). I0430 13:45:21.545542 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:45:21.545562 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-mt7cb pod in namespace openshift-image-registry (previous: false). I0430 13:45:21.744622 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0430 13:45:21.744640 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-78d8696859-m46ql pod in namespace openshift-ingress (previous: false). I0430 13:45:21.945779 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-78d8696859-m46ql pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-78d8696859-m46ql\" is waiting to start: ContainerCreating" I0430 13:45:21.945800 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-78d8696859-m46ql\" is waiting to start: ContainerCreating" I0430 13:45:21.945811 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-78d8696859-m9vs8 pod in namespace openshift-ingress (previous: false). I0430 13:45:22.144845 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-78d8696859-m9vs8 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-78d8696859-m9vs8\" is waiting to start: ContainerCreating" I0430 13:45:22.144868 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-78d8696859-m9vs8\" is waiting to start: ContainerCreating" I0430 13:45:22.144881 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-8699976bf-jvcsf pod in namespace openshift-ingress (previous: false). W0430 13:45:22.330163 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0430 13:45:22.350182 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-8699976bf-jvcsf pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-8699976bf-jvcsf\" is waiting to start: ContainerCreating" I0430 13:45:22.350215 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-8699976bf-jvcsf\" is waiting to start: ContainerCreating" I0430 13:45:22.350225 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-bkg8c pod in namespace openshift-ingress-canary (previous: false). I0430 13:45:22.543315 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-kvqw5 pod in namespace openshift-ingress-canary (previous: false). I0430 13:45:22.744018 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-lcr9j pod in namespace openshift-ingress-canary (previous: false). I0430 13:45:22.966520 1 tasks_processing.go:74] worker 41 stopped. I0430 13:45:22.966610 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=bd3ded257c3a07f96ea13d8cfd0d8ad696afbb523b937e2dae96ef2ff83cb1e8 I0430 13:45:22.966664 1 recorder.go:75] Recording events/openshift-dns with fingerprint=e2fe0112138a210ee23f8565c8faf204cd70c7be6938eaefc0257e65ce75ea62 I0430 13:45:22.966752 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=e45bed647ec12344159253817158e180045dad1d52edaf47966956426df28011 I0430 13:45:22.966781 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=dc53d95cd8fb5c27d93d9b0e0c32019b57b36d461dd234603493f9d03cc1db3f I0430 13:45:22.966843 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=1e358cd10bcca25e688f0e5991cbb0178aa6d2f62524f9cef63cfb512b750580 I0430 13:45:22.966882 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=dbbdc5b519cb1ec55a643584ee7000346e1efa480da0bb738d25671ec07b93b1 I0430 13:45:22.966889 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-bkg8c/serve-healthcheck-canary_current.log with fingerprint=7fa0e0b2f16ea753da485aa93fce784a7b04bceed1281b045b4d7c2f099e781b I0430 13:45:22.966894 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-kvqw5/serve-healthcheck-canary_current.log with fingerprint=6b67ffe1bbf8a2d146e4eb8240ffd477eccf526d473c22bc6b74c188537afe5c I0430 13:45:22.966898 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-lcr9j/serve-healthcheck-canary_current.log with fingerprint=122d2d19aff40a9c4f9ff295624358ce48ef377bdf886855000d2844f4636baa I0430 13:45:22.966904 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.6787702s to process 9 records W0430 13:45:23.330087 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0430 13:45:23.330118 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0430 13:45:23.330135 1 tasks_processing.go:74] worker 29 stopped. E0430 13:45:23.330147 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0430 13:45:23.330157 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0430 13:45:23.330171 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0430 13:45:23.330184 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.040963832s to process 1 records I0430 13:45:30.737229 1 tasks_processing.go:74] worker 18 stopped. I0430 13:45:30.737267 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0430 13:45:30.737280 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.446275585s to process 1 records I0430 13:45:31.316734 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:45:31.500668 1 tasks_processing.go:74] worker 63 stopped. I0430 13:45:31.500982 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=698b3ed6ac2dcbbe305b75e3c37787498192c269ee2964c1d49d551d6371b6d6 I0430 13:45:31.501002 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.21029774s to process 1 records E0430 13:45:31.501066 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.214s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0430 13:45:31.502179 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0430 13:45:31.502196 1 periodic.go:216] Running workloads gatherer I0430 13:45:31.502213 1 tasks_processing.go:45] number of workers: 2 I0430 13:45:31.502224 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:45:31.502229 1 tasks_processing.go:71] worker 1 working on workload_info task. I0430 13:45:31.502237 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:45:31.502262 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0430 13:45:31.537128 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0430 13:45:31.549578 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (13ms) I0430 13:45:31.554020 1 tasks_processing.go:74] worker 0 stopped. I0430 13:45:31.554038 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 51.737803ms to process 0 records I0430 13:45:31.563457 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (14ms) I0430 13:45:31.579192 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (16ms) I0430 13:45:31.593198 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (14ms) I0430 13:45:31.606738 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (14ms) I0430 13:45:31.619946 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (13ms) I0430 13:45:31.635505 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (16ms) I0430 13:45:31.648566 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (13ms) I0430 13:45:31.662096 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (14ms) I0430 13:45:31.675830 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (14ms) I0430 13:45:31.692032 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (16ms) I0430 13:45:31.750429 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (58ms) I0430 13:45:31.855609 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (105ms) I0430 13:45:31.951370 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (96ms) I0430 13:45:32.055882 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (104ms) I0430 13:45:32.151027 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (95ms) I0430 13:45:32.255689 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (105ms) I0430 13:45:32.350875 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (95ms) I0430 13:45:32.453430 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (103ms) I0430 13:45:32.550887 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (97ms) I0430 13:45:32.654932 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (104ms) I0430 13:45:32.750630 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (96ms) I0430 13:45:32.854588 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (104ms) I0430 13:45:32.952342 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (98ms) I0430 13:45:33.053507 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (101ms) I0430 13:45:33.149773 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (96ms) I0430 13:45:33.255404 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (106ms) I0430 13:45:33.349589 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (94ms) I0430 13:45:33.457896 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (108ms) I0430 13:45:33.552681 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (95ms) I0430 13:45:33.655377 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (103ms) I0430 13:45:33.750092 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (95ms) I0430 13:45:33.854809 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (105ms) I0430 13:45:33.854853 1 tasks_processing.go:74] worker 1 stopped. E0430 13:45:33.854863 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0430 13:45:33.855125 1 recorder.go:75] Recording config/workload_info with fingerprint=29a0ab26484891e30e7ffd09d7132014c477811f2bf55e6af9cba392d9827d83 I0430 13:45:33.855141 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.352618005s to process 1 records E0430 13:45:33.855163 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.352s with: function \"workload_info\" failed with an error" I0430 13:45:33.856272 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0430 13:45:33.856286 1 periodic.go:216] Running conditional gatherer I0430 13:45:33.865307 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0430 13:45:33.871841 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.15:57705->172.30.0.10:53: read: connection refused E0430 13:45:33.872087 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0430 13:45:33.872174 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0430 13:45:33.881102 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0430 13:45:33.881117 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:45:33.881122 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:45:33.881126 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:45:33.881129 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:45:33.881132 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:45:33.881137 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:45:33.881140 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:45:33.881143 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0430 13:45:33.881146 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0430 13:45:33.881161 1 tasks_processing.go:45] number of workers: 3 I0430 13:45:33.881175 1 tasks_processing.go:69] worker 2 listening for tasks. I0430 13:45:33.881176 1 tasks_processing.go:69] worker 0 listening for tasks. I0430 13:45:33.881183 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0430 13:45:33.881186 1 tasks_processing.go:69] worker 1 listening for tasks. I0430 13:45:33.881196 1 tasks_processing.go:74] worker 1 stopped. I0430 13:45:33.881207 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0430 13:45:33.881258 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0430 13:45:33.881298 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0430 13:45:33.881316 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.112µs to process 1 records I0430 13:45:33.881364 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0430 13:45:33.881375 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.181µs to process 1 records I0430 13:45:33.881382 1 tasks_processing.go:74] worker 2 stopped. I0430 13:45:33.881562 1 tasks_processing.go:74] worker 0 stopped. I0430 13:45:33.881578 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 345.873µs to process 0 records I0430 13:45:33.881605 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.15:57705->172.30.0.10:53: read: connection refused I0430 13:45:33.881625 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0430 13:45:33.911440 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=9d8e59b3df8e6d18b03658c150418c8f07bfc58bf632a61e368350e0b9435ffe I0430 13:45:33.911580 1 diskrecorder.go:70] Writing 102 records to /var/lib/insights-operator/insights-2026-04-30-134533.tar.gz I0430 13:45:33.917583 1 diskrecorder.go:51] Wrote 102 records to disk in 6ms I0430 13:45:33.917627 1 periodic.go:285] Gathering cluster info every 2h0m0s I0430 13:45:33.917646 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0430 13:45:34.058217 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:45:34.259491 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:45:44.235573 1 configmapobserver.go:84] configmaps "insights-config" not found I0430 13:46:22.755148 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="679e51291d3db323be4be9611a028823132c59ee488a0c70350c26beb1c9e27f") W0430 13:46:22.755186 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0430 13:46:22.755239 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="da1610892139fa49ceea98c5e46a17e0c1e85a50d589aae96ff9e1d4ecae5db2") I0430 13:46:22.755257 1 periodic.go:177] Shutting down