I0507 13:03:46.955650 1 cmd.go:253] Using service-serving-cert provided certificates I0507 13:03:46.956681 1 observer_polling.go:159] Starting file observer I0507 13:03:47.686400 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0507 13:03:47.686596 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0507 13:03:47.687174 1 secure_serving.go:57] Forcing use of http/1.1 only W0507 13:03:47.687195 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0507 13:03:47.687199 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0507 13:03:47.687203 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0507 13:03:47.687205 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0507 13:03:47.687208 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0507 13:03:47.687210 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0507 13:03:47.687221 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0507 13:03:47.691663 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0507 13:03:47.691677 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c753ecbe-bf2f-43d3-8707-ee74e66215fb", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0507 13:03:47.695286 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0507 13:03:47.695304 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0507 13:03:47.695306 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0507 13:03:47.695311 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0507 13:03:47.695321 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 13:03:47.695322 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 13:03:47.695567 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0507 13:03:47.695848 1 secure_serving.go:213] Serving securely on [::]:8443 I0507 13:03:47.695874 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0507 13:03:47.698528 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0507 13:03:47.698552 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 13:03:47.698660 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0507 13:03:47.705199 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:03:47.705216 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 13:03:47.713038 1 secretconfigobserver.go:119] support secret does not exist I0507 13:03:47.719415 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:03:47.725321 1 secretconfigobserver.go:119] support secret does not exist I0507 13:03:47.731359 1 recorder.go:161] Pruning old reports every 4h53m22s, max age is 288h0m0s I0507 13:03:47.738897 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0507 13:03:47.738916 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0507 13:03:47.738923 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0507 13:03:47.738933 1 insightsreport.go:296] Starting report retriever I0507 13:03:47.738935 1 periodic.go:209] Running clusterconfig gatherer I0507 13:03:47.738944 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0507 13:03:47.738972 1 tasks_processing.go:45] number of workers: 64 I0507 13:03:47.739014 1 tasks_processing.go:69] worker 63 listening for tasks. I0507 13:03:47.739020 1 tasks_processing.go:71] worker 63 working on image_registries task. I0507 13:03:47.739052 1 tasks_processing.go:69] worker 31 listening for tasks. I0507 13:03:47.739062 1 tasks_processing.go:69] worker 15 listening for tasks. I0507 13:03:47.739066 1 tasks_processing.go:69] worker 16 listening for tasks. I0507 13:03:47.739067 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 13:03:47.739070 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 13:03:47.739080 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 13:03:47.739083 1 tasks_processing.go:69] worker 17 listening for tasks. I0507 13:03:47.739086 1 tasks_processing.go:69] worker 3 listening for tasks. I0507 13:03:47.739091 1 tasks_processing.go:69] worker 4 listening for tasks. I0507 13:03:47.739087 1 tasks_processing.go:69] worker 47 listening for tasks. I0507 13:03:47.739096 1 tasks_processing.go:69] worker 5 listening for tasks. I0507 13:03:47.739092 1 tasks_processing.go:69] worker 24 listening for tasks. I0507 13:03:47.739093 1 tasks_processing.go:69] worker 25 listening for tasks. I0507 13:03:47.739106 1 tasks_processing.go:69] worker 19 listening for tasks. I0507 13:03:47.739100 1 tasks_processing.go:69] worker 18 listening for tasks. I0507 13:03:47.739105 1 tasks_processing.go:69] worker 6 listening for tasks. I0507 13:03:47.739115 1 tasks_processing.go:69] worker 30 listening for tasks. I0507 13:03:47.739110 1 tasks_processing.go:69] worker 28 listening for tasks. I0507 13:03:47.739134 1 tasks_processing.go:69] worker 32 listening for tasks. I0507 13:03:47.739136 1 tasks_processing.go:69] worker 21 listening for tasks. I0507 13:03:47.739137 1 tasks_processing.go:69] worker 26 listening for tasks. I0507 13:03:47.739147 1 tasks_processing.go:69] worker 33 listening for tasks. I0507 13:03:47.739143 1 tasks_processing.go:69] worker 43 listening for tasks. I0507 13:03:47.739144 1 tasks_processing.go:69] worker 27 listening for tasks. I0507 13:03:47.739153 1 tasks_processing.go:69] worker 55 listening for tasks. I0507 13:03:47.739151 1 tasks_processing.go:69] worker 46 listening for tasks. I0507 13:03:47.739153 1 tasks_processing.go:69] worker 34 listening for tasks. I0507 13:03:47.739158 1 tasks_processing.go:69] worker 35 listening for tasks. I0507 13:03:47.739163 1 tasks_processing.go:69] worker 52 listening for tasks. I0507 13:03:47.739160 1 tasks_processing.go:69] worker 48 listening for tasks. I0507 13:03:47.739164 1 tasks_processing.go:69] worker 38 listening for tasks. I0507 13:03:47.739158 1 tasks_processing.go:69] worker 13 listening for tasks. I0507 13:03:47.739172 1 tasks_processing.go:69] worker 54 listening for tasks. I0507 13:03:47.739174 1 tasks_processing.go:69] worker 58 listening for tasks. I0507 13:03:47.739176 1 tasks_processing.go:69] worker 60 listening for tasks. I0507 13:03:47.739169 1 tasks_processing.go:69] worker 51 listening for tasks. I0507 13:03:47.739155 1 tasks_processing.go:69] worker 49 listening for tasks. I0507 13:03:47.739182 1 tasks_processing.go:69] worker 57 listening for tasks. I0507 13:03:47.739168 1 tasks_processing.go:69] worker 56 listening for tasks. I0507 13:03:47.739184 1 tasks_processing.go:69] worker 50 listening for tasks. I0507 13:03:47.739102 1 tasks_processing.go:69] worker 29 listening for tasks. I0507 13:03:47.739109 1 tasks_processing.go:69] worker 7 listening for tasks. I0507 13:03:47.739113 1 tasks_processing.go:69] worker 8 listening for tasks. I0507 13:03:47.739115 1 tasks_processing.go:69] worker 40 listening for tasks. I0507 13:03:47.739117 1 tasks_processing.go:69] worker 9 listening for tasks. I0507 13:03:47.739120 1 tasks_processing.go:69] worker 20 listening for tasks. I0507 13:03:47.739122 1 tasks_processing.go:69] worker 10 listening for tasks. I0507 13:03:47.739120 1 tasks_processing.go:69] worker 39 listening for tasks. I0507 13:03:47.739126 1 tasks_processing.go:69] worker 11 listening for tasks. I0507 13:03:47.739128 1 tasks_processing.go:69] worker 22 listening for tasks. I0507 13:03:47.739124 1 tasks_processing.go:69] worker 41 listening for tasks. I0507 13:03:47.739124 1 tasks_processing.go:69] worker 23 listening for tasks. I0507 13:03:47.739132 1 tasks_processing.go:69] worker 12 listening for tasks. I0507 13:03:47.739136 1 tasks_processing.go:69] worker 44 listening for tasks. I0507 13:03:47.739136 1 tasks_processing.go:69] worker 42 listening for tasks. I0507 13:03:47.739138 1 tasks_processing.go:69] worker 14 listening for tasks. I0507 13:03:47.739145 1 tasks_processing.go:69] worker 45 listening for tasks. I0507 13:03:47.739151 1 tasks_processing.go:69] worker 36 listening for tasks. I0507 13:03:47.739155 1 tasks_processing.go:69] worker 37 listening for tasks. I0507 13:03:47.739163 1 tasks_processing.go:69] worker 59 listening for tasks. I0507 13:03:47.739169 1 tasks_processing.go:69] worker 61 listening for tasks. I0507 13:03:47.739171 1 tasks_processing.go:69] worker 62 listening for tasks. I0507 13:03:47.739170 1 tasks_processing.go:69] worker 53 listening for tasks. I0507 13:03:47.739243 1 tasks_processing.go:71] worker 31 working on schedulers task. I0507 13:03:47.739250 1 tasks_processing.go:71] worker 26 working on validating_webhook_configurations task. I0507 13:03:47.739253 1 tasks_processing.go:71] worker 53 working on pdbs task. I0507 13:03:47.739259 1 tasks_processing.go:71] worker 35 working on install_plans task. I0507 13:03:47.739264 1 tasks_processing.go:71] worker 43 working on container_runtime_configs task. I0507 13:03:47.739266 1 tasks_processing.go:71] worker 48 working on silenced_alerts task. I0507 13:03:47.739277 1 tasks_processing.go:71] worker 38 working on nodes task. I0507 13:03:47.739253 1 tasks_processing.go:71] worker 46 working on pod_network_connectivity_checks task. I0507 13:03:47.739309 1 tasks_processing.go:71] worker 15 working on support_secret task. I0507 13:03:47.739322 1 tasks_processing.go:71] worker 2 working on ingress task. I0507 13:03:47.739330 1 tasks_processing.go:71] worker 6 working on active_alerts task. I0507 13:03:47.739350 1 tasks_processing.go:71] worker 0 working on proxies task. I0507 13:03:47.739255 1 tasks_processing.go:71] worker 34 working on nodenetworkstates task. I0507 13:03:47.739370 1 tasks_processing.go:71] worker 1 working on metrics task. I0507 13:03:47.739372 1 tasks_processing.go:71] worker 16 working on openstack_version task. I0507 13:03:47.739380 1 tasks_processing.go:71] worker 17 working on machine_autoscalers task. I0507 13:03:47.739384 1 tasks_processing.go:71] worker 25 working on mutating_webhook_configurations task. I0507 13:03:47.739388 1 tasks_processing.go:71] worker 27 working on openstack_controlplanes task. I0507 13:03:47.739398 1 tasks_processing.go:71] worker 4 working on openstack_dataplanedeployments task. I0507 13:03:47.739421 1 tasks_processing.go:71] worker 47 working on olm_operators task. I0507 13:03:47.739430 1 tasks_processing.go:71] worker 58 working on ingress_certificates task. I0507 13:03:47.739380 1 tasks_processing.go:71] worker 24 working on certificate_signing_requests task. I0507 13:03:47.739483 1 tasks_processing.go:71] worker 39 working on lokistack task. I0507 13:03:47.739426 1 tasks_processing.go:71] worker 54 working on machine_config_pools task. I0507 13:03:47.739552 1 tasks_processing.go:71] worker 55 working on version task. I0507 13:03:47.739590 1 tasks_processing.go:71] worker 29 working on oauths task. I0507 13:03:47.739594 1 tasks_processing.go:71] worker 42 working on feature_gates task. I0507 13:03:47.739602 1 tasks_processing.go:71] worker 3 working on storage_cluster task. I0507 13:03:47.739651 1 tasks_processing.go:71] worker 37 working on networks task. I0507 13:03:47.739680 1 tasks_processing.go:71] worker 7 working on image_pruners task. I0507 13:03:47.739772 1 tasks_processing.go:71] worker 11 working on machines task. I0507 13:03:47.739806 1 tasks_processing.go:71] worker 62 working on sap_config task. I0507 13:03:47.739865 1 tasks_processing.go:71] worker 20 working on crds task. I0507 13:03:47.739869 1 tasks_processing.go:71] worker 8 working on dvo_metrics task. I0507 13:03:47.739259 1 tasks_processing.go:71] worker 33 working on cluster_apiserver task. I0507 13:03:47.740145 1 tasks_processing.go:71] worker 56 working on sap_pods task. I0507 13:03:47.740182 1 tasks_processing.go:71] worker 10 working on machine_sets task. I0507 13:03:47.740189 1 tasks_processing.go:71] worker 22 working on overlapping_namespace_uids task. I0507 13:03:47.740197 1 tasks_processing.go:71] worker 61 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0507 13:03:47.740225 1 tasks_processing.go:71] worker 32 working on service_accounts task. I0507 13:03:47.740233 1 tasks_processing.go:71] worker 14 working on authentication task. I0507 13:03:47.740271 1 tasks_processing.go:71] worker 52 working on node_logs task. I0507 13:03:47.740280 1 tasks_processing.go:71] worker 18 working on infrastructures task. I0507 13:03:47.740367 1 tasks_processing.go:71] worker 45 working on operators_pods_and_events task. I0507 13:03:47.740410 1 tasks_processing.go:71] worker 28 working on nodenetworkconfigurationpolicies task. I0507 13:03:47.740411 1 tasks_processing.go:71] worker 41 working on cost_management_metrics_configs task. I0507 13:03:47.740570 1 tasks_processing.go:71] worker 12 working on jaegers task. I0507 13:03:47.739250 1 tasks_processing.go:71] worker 13 working on monitoring_persistent_volumes task. I0507 13:03:47.740275 1 tasks_processing.go:71] worker 19 working on storage_classes task. I0507 13:03:47.740678 1 tasks_processing.go:71] worker 49 working on ceph_cluster task. I0507 13:03:47.740387 1 tasks_processing.go:71] worker 36 working on config_maps task. I0507 13:03:47.740910 1 tasks_processing.go:71] worker 50 working on clusterroles task. I0507 13:03:47.740945 1 tasks_processing.go:71] worker 60 working on image task. I0507 13:03:47.740952 1 tasks_processing.go:71] worker 44 working on operators task. I0507 13:03:47.740393 1 tasks_processing.go:71] worker 30 working on machine_configs task. I0507 13:03:47.740382 1 tasks_processing.go:71] worker 40 working on aggregated_monitoring_cr_names task. I0507 13:03:47.740398 1 tasks_processing.go:71] worker 59 working on machine_healthchecks task. I0507 13:03:47.740380 1 tasks_processing.go:71] worker 21 working on sap_datahubs task. I0507 13:03:47.740954 1 tasks_processing.go:71] worker 51 working on tsdb_status task. I0507 13:03:47.739305 1 tasks_processing.go:71] worker 5 working on qemu_kubevirt_launcher_logs task. I0507 13:03:47.740140 1 tasks_processing.go:71] worker 57 working on openshift_machine_api_events task. I0507 13:03:47.740406 1 tasks_processing.go:71] worker 23 working on container_images task. I0507 13:03:47.742363 1 tasks_processing.go:71] worker 9 working on openstack_dataplanenodesets task. I0507 13:03:47.743475 1 tasks_processing.go:71] worker 4 working on openshift_logging task. I0507 13:03:47.743494 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 4.061763ms to process 0 records I0507 13:03:47.743570 1 tasks_processing.go:74] worker 16 stopped. I0507 13:03:47.743584 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 4.181801ms to process 0 records I0507 13:03:47.743670 1 tasks_processing.go:74] worker 27 stopped. I0507 13:03:47.743689 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 4.266153ms to process 0 records I0507 13:03:47.744632 1 tasks_processing.go:74] worker 39 stopped. I0507 13:03:47.744644 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 5.131263ms to process 0 records I0507 13:03:47.745061 1 tasks_processing.go:74] worker 3 stopped. I0507 13:03:47.745071 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 5.444706ms to process 0 records E0507 13:03:47.747181 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.98.157:9091: connect: connection refused I0507 13:03:47.747196 1 tasks_processing.go:74] worker 51 stopped. E0507 13:03:47.747202 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.98.157:9091: connect: connection refused I0507 13:03:47.747212 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 5.336362ms to process 0 records E0507 13:03:47.747215 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.98.157:9091: connect: connection refused I0507 13:03:47.747231 1 tasks_processing.go:74] worker 1 stopped. E0507 13:03:47.747238 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.98.157:9091: connect: connection refused I0507 13:03:47.747250 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 7.853172ms to process 0 records I0507 13:03:47.747451 1 tasks_processing.go:74] worker 0 stopped. I0507 13:03:47.747554 1 recorder.go:75] Recording config/proxy with fingerprint=8e11d1918bfc2cd5aba97f780a430ae43bfdef542908f2620b17b3f7b466f6ac I0507 13:03:47.747567 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 8.082471ms to process 1 records I0507 13:03:47.748527 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0507 13:03:47.748542 1 controller.go:326] The initial operator extension status is healthy I0507 13:03:47.748549 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0507 13:03:47.748554 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 13:03:47.748557 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0507 13:03:47.748570 1 controller.go:489] The operator is still being initialized I0507 13:03:47.748578 1 controller.go:512] The operator is healthy I0507 13:03:47.748634 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0507 13:03:47.748639 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0507 13:03:47.748776 1 operator.go:288] started I0507 13:03:47.748797 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0507 13:03:47.750631 1 tasks_processing.go:74] worker 42 stopped. I0507 13:03:47.750783 1 recorder.go:75] Recording config/featuregate with fingerprint=42a948a3a483aed750027664c1c43f78298a840a757fa57b017f9ababe236ddf I0507 13:03:47.750799 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 11.021392ms to process 1 records I0507 13:03:47.751154 1 tasks_processing.go:74] worker 31 stopped. I0507 13:03:47.751220 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=0ac21d47d5e2001d66aada0518b829f103817d8af0387580655e11ef897cb0d0 I0507 13:03:47.751233 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 11.896479ms to process 1 records I0507 13:03:47.755399 1 tasks_processing.go:74] worker 18 stopped. I0507 13:03:47.755898 1 recorder.go:75] Recording config/infrastructure with fingerprint=d94c804c0c0bc1cafd06df980bb503419a1bf281bd9ab250692ef5c5fac4b94b I0507 13:03:47.755911 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 15.095181ms to process 1 records I0507 13:03:47.758533 1 tasks_processing.go:74] worker 14 stopped. I0507 13:03:47.758769 1 recorder.go:75] Recording config/authentication with fingerprint=13177b224f3bd448bece4c8c2c041236cd6fd9856868e652d0deb6ba4b7d7e99 I0507 13:03:47.758784 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 18.2917ms to process 1 records I0507 13:03:47.759088 1 tasks_processing.go:74] worker 63 stopped. I0507 13:03:47.759478 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=072e9eeb8b3a3c5995fceee7ddf2452637ba63a7aafbfab6ef761d8dfe955016 I0507 13:03:47.759490 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 20.054957ms to process 1 records I0507 13:03:47.759842 1 tasks_processing.go:74] worker 62 stopped. I0507 13:03:47.759851 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 20.020649ms to process 0 records I0507 13:03:47.759856 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 20.459321ms to process 0 records I0507 13:03:47.759861 1 tasks_processing.go:74] worker 17 stopped. I0507 13:03:47.759866 1 tasks_processing.go:74] worker 41 stopped. I0507 13:03:47.759873 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 19.438463ms to process 0 records I0507 13:03:47.759878 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 19.177552ms to process 0 records I0507 13:03:47.759883 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 19.294895ms to process 0 records I0507 13:03:47.759886 1 tasks_processing.go:74] worker 12 stopped. I0507 13:03:47.759889 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 20.509619ms to process 0 records I0507 13:03:47.759893 1 tasks_processing.go:74] worker 34 stopped. I0507 13:03:47.759891 1 tasks_processing.go:74] worker 49 stopped. I0507 13:03:47.759899 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 20.618618ms to process 0 records E0507 13:03:47.759907 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0507 13:03:47.759921 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 20.581208ms to process 0 records I0507 13:03:47.759929 1 tasks_processing.go:74] worker 46 stopped. I0507 13:03:47.759935 1 tasks_processing.go:74] worker 43 stopped. I0507 13:03:47.760076 1 tasks_processing.go:74] worker 11 stopped. E0507 13:03:47.760090 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0507 13:03:47.760100 1 gather.go:177] gatherer "clusterconfig" function "machines" took 20.280379ms to process 0 records I0507 13:03:47.763858 1 tasks_processing.go:74] worker 7 stopped. I0507 13:03:47.763933 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=b20a0073070e449afb1f3b840770858f72255d78173111da7bdf34b67e901e82 I0507 13:03:47.763945 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 24.162762ms to process 1 records I0507 13:03:47.765336 1 tasks_processing.go:74] worker 2 stopped. I0507 13:03:47.765462 1 recorder.go:75] Recording config/ingress with fingerprint=5da041811dc40a2ad90ef92b0d141ffb98a996c602c0f3ca48c750b5244001d5 I0507 13:03:47.765475 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 25.999036ms to process 1 records I0507 13:03:47.765747 1 tasks_processing.go:74] worker 29 stopped. I0507 13:03:47.765940 1 recorder.go:75] Recording config/oauth with fingerprint=446533312cba34f11186e7356c995f42fed14bc75d0e2be82e2d2652a3147ac2 I0507 13:03:47.765955 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 26.12107ms to process 1 records W0507 13:03:47.768833 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 13:03:47.774402 1 tasks_processing.go:74] worker 54 stopped. I0507 13:03:47.774415 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 34.852902ms to process 0 records I0507 13:03:47.774514 1 tasks_processing.go:74] worker 33 stopped. I0507 13:03:47.774677 1 recorder.go:75] Recording config/apiserver with fingerprint=6f74f308bc6fcd8c1be5ed900c2734bfb10ff4146e60eeee21daec11d285f9cc I0507 13:03:47.774694 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 34.355019ms to process 1 records I0507 13:03:47.774707 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 34.248922ms to process 0 records I0507 13:03:47.774714 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 34.375118ms to process 0 records I0507 13:03:47.774714 1 tasks_processing.go:74] worker 52 stopped. I0507 13:03:47.774719 1 tasks_processing.go:74] worker 10 stopped. I0507 13:03:47.774719 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 34.293046ms to process 0 records I0507 13:03:47.774725 1 tasks_processing.go:74] worker 28 stopped. I0507 13:03:47.775043 1 tasks_processing.go:74] worker 21 stopped. I0507 13:03:47.775056 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 33.446876ms to process 0 records I0507 13:03:47.775439 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 13:03:47.775453 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0507 13:03:47.775457 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0507 13:03:47.775462 1 controller.go:212] Source scaController *sca.Controller is not ready I0507 13:03:47.775466 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0507 13:03:47.775486 1 controller.go:489] The operator is still being initialized I0507 13:03:47.775498 1 controller.go:512] The operator is healthy I0507 13:03:47.775527 1 tasks_processing.go:74] worker 59 stopped. E0507 13:03:47.775538 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0507 13:03:47.775545 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 34.067206ms to process 0 records I0507 13:03:47.775799 1 tasks_processing.go:74] worker 15 stopped. E0507 13:03:47.775808 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0507 13:03:47.775814 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 36.479495ms to process 0 records I0507 13:03:47.775986 1 tasks_processing.go:74] worker 19 stopped. I0507 13:03:47.776111 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=8303590d0e0ce6aa03fae88bc2542c6afba1f08523d1e138d8aecfab00b235ba I0507 13:03:47.776128 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=9041e29b58f108d54fd43dbf808c440ffca96d9ac02a21ad5766a6cae60757e5 I0507 13:03:47.776135 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 35.35801ms to process 2 records I0507 13:03:47.776141 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 35.988171ms to process 0 records I0507 13:03:47.776147 1 tasks_processing.go:74] worker 56 stopped. I0507 13:03:47.776410 1 tasks_processing.go:74] worker 9 stopped. I0507 13:03:47.776425 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 33.995839ms to process 0 records I0507 13:03:47.776466 1 tasks_processing.go:74] worker 60 stopped. I0507 13:03:47.776539 1 recorder.go:75] Recording config/image with fingerprint=83a4508db2cfcdd61b2520628a01272a576f7206e47feac4061b2f6e1812e016 I0507 13:03:47.776550 1 gather.go:177] gatherer "clusterconfig" function "image" took 35.486586ms to process 1 records I0507 13:03:47.776663 1 tasks_processing.go:74] worker 4 stopped. I0507 13:03:47.776677 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 33.166731ms to process 0 records I0507 13:03:47.776886 1 tasks_processing.go:74] worker 24 stopped. I0507 13:03:47.776898 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 37.440187ms to process 0 records I0507 13:03:47.777414 1 tasks_processing.go:74] worker 25 stopped. I0507 13:03:47.777566 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=961748f6837939774304aae300df8c98bcb8fcadbab16b510d06942da2606bb7 I0507 13:03:47.777598 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=22c49fc5f6971f70690b8e9ee9f22d87fa05eed12efe60f816ee15441db5cb86 I0507 13:03:47.777626 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=a4c8fb83cc67bf857777547d4e735b7594036be5146db264d7063ad8cb361b09 I0507 13:03:47.777634 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 38.015074ms to process 3 records I0507 13:03:47.795696 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 13:03:47.795708 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 13:03:47.795747 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0507 13:03:47.798706 1 base_controller.go:82] Caches are synced for ConfigController I0507 13:03:47.798719 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0507 13:03:47.807871 1 tasks_processing.go:74] worker 57 stopped. I0507 13:03:47.807884 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 65.933727ms to process 0 records I0507 13:03:47.809423 1 tasks_processing.go:74] worker 37 stopped. I0507 13:03:47.809610 1 recorder.go:75] Recording config/network with fingerprint=6d6cfcac2bcebb9378c4d042fb1d4c6ac347a5f9923babc9ea4e6c0f7400c8a3 I0507 13:03:47.809627 1 gather.go:177] gatherer "clusterconfig" function "networks" took 69.755404ms to process 1 records I0507 13:03:47.810940 1 tasks_processing.go:74] worker 13 stopped. I0507 13:03:47.810954 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 70.344524ms to process 0 records I0507 13:03:47.811638 1 tasks_processing.go:74] worker 47 stopped. I0507 13:03:47.811687 1 recorder.go:75] Recording config/olm_operators with fingerprint=e51f8f9589e30e114e2d1748a7d5cd4cc310a9c5d8d6de4ddd510c3e064db74c I0507 13:03:47.811700 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 72.200345ms to process 1 records I0507 13:03:47.815027 1 tasks_processing.go:74] worker 53 stopped. I0507 13:03:47.815124 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=d3acf34bc05c60a788522c148e475f6775849e2c13cc45092b9cee699826f601 I0507 13:03:47.815146 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=c1c52676e3e6a6bf7b664d6f85add889bf814a0d8acab742ca5a693e6d695993 I0507 13:03:47.815160 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=6503f898c02b10bfc91d91d29a2c9712d0e0c8d2d5381bb3689885cc1ee87bbd I0507 13:03:47.815174 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=0b87fb9f38c0de67ade1a53d6fe3659f327c25f310103560fd2b2fa29ec7ed1a I0507 13:03:47.815198 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=1a65249ef9b87770a515753ae3c1ca17f0d541ad8629e8e37cfe25a2e432c69c I0507 13:03:47.815223 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=e6396cb8ebbf6fccc7ed67ed4d766d50164bd01430865af21c8cf48ad29c234c I0507 13:03:47.815250 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=0bb3a3771683ec0447b6964d4eade7a59e20bfc81f3772cfbb250f7908fd7e86 I0507 13:03:47.815278 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=083eb196a988e08e0ec957ee45b4137c069ac727414fbd4296740b090924cdba I0507 13:03:47.815297 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=cab832314f039046b1b960b5bd67f04b77e2291330dffd06fde2e765227b7255 I0507 13:03:47.815312 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=9dc76f014c57859dab5c2081fef130adf24b65a989c2abda1c119d37807e32c5 I0507 13:03:47.815332 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=960305f5aafc502a63550e607a61345fd633aee41a62aeeb46ac4d346ade881d I0507 13:03:47.815347 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 75.76126ms to process 11 records I0507 13:03:47.818712 1 tasks_processing.go:74] worker 26 stopped. I0507 13:03:47.818944 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=23c2860b270a4be394177888a2259e63fe6ad09ac5e11d04950d0c7d5949e70f I0507 13:03:47.819075 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=b964b99f51a4ef5fd48b6e827e97cd09adf4393d9cc89be3a666a5ceeb412107 I0507 13:03:47.819238 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=0cfa32137bfb5c79b06338280b8f4c1222657ee17b9362500a1d8997a3139fd7 I0507 13:03:47.819307 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=71ed8580fe8cd31199ce836dc727ff070f62c781f19e0910a69d4a1b0e8c70dc I0507 13:03:47.819365 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=e82e794941ce5d76fe64966d46cc9af93e33345ac1ff67a1e7bec9bc14cc37a3 I0507 13:03:47.819428 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=cfe8e414dc5538ae9e82a9002423ef50565e02b19614fc57bc6d0db09fe62e31 I0507 13:03:47.819509 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=9ee6fa169feeeb5f0f604091550ca8a3164c5c939a46e67cb9d17b2d07f743a3 I0507 13:03:47.819863 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=695531e6e430a8e37a8f22d48488725c9772459632b869b0139f19eb1352a68e I0507 13:03:47.819928 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=db20a69008a975eb1ab4c3f1b3dc13bd6f9d610358f5a12ddd98506383b00dad I0507 13:03:47.820293 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=469efc87cc120d1f7e0aa2c06fba15a01ce90c84ab8c730d381e2bdac5c9e2e9 I0507 13:03:47.820322 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=b89dc249e5c1f8b43b03d312884f4b8e2cf2cbc05180bc960a91bf9dfb921a9c I0507 13:03:47.820346 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=5158bbea1e676bd8192dc93b3d66b31a3c0774326f46ca7bcc67ac9ea0e139b5 I0507 13:03:47.820371 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=e4fd9cc207fb798530019fed060b5c5379ec6490de11c5da06f1194692ec475e I0507 13:03:47.820379 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 79.450741ms to process 13 records I0507 13:03:47.820486 1 tasks_processing.go:74] worker 22 stopped. I0507 13:03:47.820516 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0507 13:03:47.820530 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 80.277535ms to process 1 records I0507 13:03:47.835542 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:03:47.835791 1 tasks_processing.go:74] worker 20 stopped. I0507 13:03:47.836270 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=ea072d86c866afedd772a0293bafde6d4fe277528b4b971ca0093955346a826c I0507 13:03:47.836490 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=3630a9563aaff83f1b07383b71ad4196dddbc6f393b0a8f671061a09a686a409 I0507 13:03:47.836505 1 gather.go:177] gatherer "clusterconfig" function "crds" took 95.912858ms to process 2 records I0507 13:03:47.837957 1 tasks_processing.go:74] worker 40 stopped. I0507 13:03:47.837973 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 96.803488ms to process 0 records I0507 13:03:47.838911 1 tasks_processing.go:74] worker 45 stopped. I0507 13:03:47.838931 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 98.485622ms to process 0 records I0507 13:03:47.845864 1 tasks_processing.go:74] worker 50 stopped. I0507 13:03:47.846242 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=1b451a5ba2095b2313c7a8b889be2c25be06f56a9888a36f74d1ea6a7046bdfe I0507 13:03:47.846523 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=ba771518326c317a879671402260993af45f72553f1ef4354fffebe5ab06bc1b I0507 13:03:47.846550 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 104.931106ms to process 2 records I0507 13:03:47.848827 1 base_controller.go:82] Caches are synced for LoggingSyncer I0507 13:03:47.848845 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0507 13:03:47.853972 1 tasks_processing.go:74] worker 61 stopped. I0507 13:03:47.853988 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 113.746461ms to process 0 records I0507 13:03:47.871602 1 tasks_processing.go:74] worker 38 stopped. I0507 13:03:47.871905 1 recorder.go:75] Recording config/node/ip-10-0-0-215.ec2.internal with fingerprint=e6291b4fed146a74134bda21e3a9e8d7cffd1f143d548f19e208572d42bf06d4 I0507 13:03:47.871969 1 recorder.go:75] Recording config/node/ip-10-0-1-74.ec2.internal with fingerprint=2fdda27dac885ff95534982c8ec6f38dcc86edee4db79f55fe009a632c72bf34 I0507 13:03:47.872020 1 recorder.go:75] Recording config/node/ip-10-0-2-127.ec2.internal with fingerprint=4eb353291cc28bb9594f39b5dae6fca1ae0a7261422695d1c5b0a6698e598d1e I0507 13:03:47.872029 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 132.311121ms to process 3 records I0507 13:03:47.882904 1 gather_logs.go:145] no pods in namespace were found I0507 13:03:47.882913 1 tasks_processing.go:74] worker 55 stopped. I0507 13:03:47.883194 1 recorder.go:75] Recording config/version with fingerprint=ae2e693d240b1bfe2ba2d936c992ab0371414c711cfe259aac9c657aa553c962 I0507 13:03:47.883208 1 recorder.go:75] Recording config/id with fingerprint=5b78a473c3a377ca4653796610126f8edafa33c621bf1a2abb8c32198478b901 I0507 13:03:47.883214 1 gather.go:177] gatherer "clusterconfig" function "version" took 143.351097ms to process 2 records I0507 13:03:47.883227 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 140.996415ms to process 0 records E0507 13:03:47.883232 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0507 13:03:47.883238 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q53j0m1bgsurbq5o54lutofrkvlr3uc-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q53j0m1bgsurbq5o54lutofrkvlr3uc-primary-cert-bundle-secret" not found I0507 13:03:47.883255 1 tasks_processing.go:74] worker 5 stopped. I0507 13:03:47.883275 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=ab66d287248dda5e451f2cf5ddecf7e95a7e54fc50219aef687e348da80e2cf3 I0507 13:03:47.883284 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 143.596939ms to process 1 records I0507 13:03:47.883293 1 tasks_processing.go:74] worker 58 stopped. I0507 13:03:47.883655 1 tasks_processing.go:74] worker 36 stopped. E0507 13:03:47.883672 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0507 13:03:47.883680 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0507 13:03:47.883684 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0507 13:03:47.883693 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0507 13:03:47.883728 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0507 13:03:47.883765 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0507 13:03:47.883771 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0507 13:03:47.883797 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0507 13:03:47.883840 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0507 13:03:47.883848 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0507 13:03:47.883853 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 142.812029ms to process 7 records I0507 13:03:47.897330 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0507 13:03:47.913557 1 tasks_processing.go:74] worker 23 stopped. I0507 13:03:47.914813 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-vqs9j with fingerprint=cb5d6f6a088882d5643ed4101aec09a78642ce42f1fd666319e8df139be78bd4 I0507 13:03:47.914887 1 recorder.go:75] Recording config/running_containers with fingerprint=b1277affe33356488725dd2a5f479bca3f4c48bcf6ee608ec2e725492cee71f2 I0507 13:03:47.914896 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 171.411007ms to process 2 records I0507 13:03:47.962135 1 tasks_processing.go:74] worker 30 stopped. I0507 13:03:47.962168 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0507 13:03:47.962180 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 220.98836ms to process 1 records I0507 13:03:47.979171 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0507 13:03:47.985767 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0507 13:03:48.002120 1 cluster_transfer.go:102] no available accepted cluster transfer I0507 13:03:48.002135 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0507 13:03:48.069563 1 sca.go:266] etc-pki-entitlement secret successfully created I0507 13:03:48.069581 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated W0507 13:03:48.769352 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 13:03:48.832356 1 tasks_processing.go:74] worker 6 stopped. I0507 13:03:48.832408 1 recorder.go:75] Recording config/alerts with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 W0507 13:03:48.832430 1 gather.go:155] issue recording gatherer "clusterconfig" function "active_alerts" result "config/alerts.json" because of the warning: warning: the record with the same fingerprint "4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945" was already recorded at path "config/namespaces_with_overlapping_uids.json", recording another one with a different path "config/alerts.json" I0507 13:03:48.832454 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.093012475s to process 1 records I0507 13:03:48.832470 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0507 13:03:48.832478 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.093091336s to process 1 records I0507 13:03:48.832484 1 tasks_processing.go:74] worker 48 stopped. W0507 13:03:49.769503 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 13:03:50.283780 1 tasks_processing.go:74] worker 44 stopped. I0507 13:03:50.283897 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=39ac771f9b28ad85e5ab5e813c47d8ac095b62e01d7dc175c25f263239098d17 I0507 13:03:50.283944 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0507 13:03:50.283969 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=3f7f3292eef316cce381e791b05325ff98452ef9fa8a99cff2695c8c5a9c3742 I0507 13:03:50.283980 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0507 13:03:50.284003 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=3c1edadcd0c045682ede253f69ecf2716b1ed78c29d01d1a4a72923857e4a157 I0507 13:03:50.284019 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0507 13:03:50.284039 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=f109cbc397e09fc6c77729cc6936ac42dd47efc44ce2f6261054f4b93e8ac9c9 I0507 13:03:50.284066 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=a14249728b2084593eecdf5eaf338396c3d611673e02a2257f9e79f608db482b I0507 13:03:50.284090 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=71e880453399213ecd485cc36a6d6edad81eafa7a6bd4589ab141b0f37b6a231 I0507 13:03:50.284121 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=0e196724d02c1f183168380b5992b848b73cbe1a5b5e6a992f8a48642c5c6d4f I0507 13:03:50.284383 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=8d61b548b0094f34ee239909d814dcd33221c8eb3bf86635930c314fb540c723 I0507 13:03:50.284403 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a6c9d7edab20a50bcd32a1e2520f20a1b98150074f53f53454a131c23f6f844e I0507 13:03:50.284410 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0507 13:03:50.284426 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=f7f0ca36a4e705105580bb36bbe91082f57d4912e1d1282ccdbad7e34fbd6233 I0507 13:03:50.284436 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0507 13:03:50.284452 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=4d629c0831fa8c966b90019f50c05aead20b6289dd7179135167166d981df47d I0507 13:03:50.284462 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0507 13:03:50.284481 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=dbf01e0c4b18c2544d783f6df276c931bab029b28b89b00d4acf1ae4cfa60c99 I0507 13:03:50.284491 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0507 13:03:50.284512 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=72835eaaabfbf113d3a3c586584d40fbafa435b6ad89d385d0f409f24981942d I0507 13:03:50.284616 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=10d385e9827f20722c63b8a8a32aeee852aadb177131ef2f78f2a9355104c697 I0507 13:03:50.284626 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0507 13:03:50.284634 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0507 13:03:50.284655 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0507 13:03:50.284677 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=1ef4abbe9d7e980e91048da9507db9d84756b8dd6aa451c1f73c0392e6f99a32 I0507 13:03:50.284700 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=1a29c05cf69eb1259e22d16486deb719ab582f61aea73b84fbccf0a263b36f0b I0507 13:03:50.284709 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0507 13:03:50.284726 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=8cbd4787d01ffdfc213192461bedf5cfce698f296fd748f79def661129e7cfd9 I0507 13:03:50.284749 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0507 13:03:50.284768 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=14553c2b5f8a66bd0442f66aa21089bd2c465c31c50502bcfc88acc889cd004d I0507 13:03:50.284777 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0507 13:03:50.284789 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=e16ca6624a4c284e332d2a3e294caed173f8efdd40dee96094c4d51acac76e02 I0507 13:03:50.284802 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=1c5ae84a0f775d1283600a7900c1feec2d684d7141ec9557d5f3154162d65ba4 I0507 13:03:50.284817 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=112d94abceaa91856d68b16ad054a70af66fb22f1dbe63d6880b3c0af69e1d85 I0507 13:03:50.284840 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=46434e41ec68d9465dcba1f59cce72ced6eeee002bff3baa13b8185c7dfd3905 I0507 13:03:50.284849 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0507 13:03:50.284876 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=42a0c9b9fb677d837ac39f0374a56945faa1f4ee48160b17fe8de04134a09c28 I0507 13:03:50.284893 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0507 13:03:50.284902 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0507 13:03:50.284909 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.542684144s to process 39 records W0507 13:03:50.769620 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0507 13:03:51.769934 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0507 13:03:52.769623 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0507 13:03:52.769725 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 13:03:52.769789 1 tasks_processing.go:74] worker 8 stopped. E0507 13:03:52.769809 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 13:03:52.769821 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0507 13:03:52.769831 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.029898111s to process 1 records I0507 13:04:00.622669 1 tasks_processing.go:74] worker 35 stopped. I0507 13:04:00.622719 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0507 13:04:00.622748 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.883391482s to process 1 records I0507 13:04:01.347869 1 tasks_processing.go:74] worker 32 stopped. I0507 13:04:01.348150 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=f5738032f28aea743b389898fadee779c5cd56b79a04dcc121fb2c80f0e9fc94 I0507 13:04:01.348167 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.607625208s to process 1 records E0507 13:04:01.348250 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.609s with: function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0507 13:04:01.349364 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "metrics" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0507 13:04:01.349379 1 periodic.go:209] Running workloads gatherer I0507 13:04:01.349392 1 tasks_processing.go:45] number of workers: 2 I0507 13:04:01.349400 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 13:04:01.349405 1 tasks_processing.go:71] worker 1 working on workload_info task. I0507 13:04:01.349412 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 13:04:01.349429 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0507 13:04:01.357187 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-74.ec2.internal... I0507 13:04:01.357207 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-127.ec2.internal... I0507 13:04:01.357226 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-215.ec2.internal... I0507 13:04:01.384044 1 tasks_processing.go:74] worker 0 stopped. I0507 13:04:01.384061 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 34.597388ms to process 0 records I0507 13:04:05.942446 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 5s I0507 13:04:05.968557 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data I0507 13:04:05.999786 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (32ms) I0507 13:04:06.010857 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (11ms) I0507 13:04:06.022273 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (11ms) I0507 13:04:06.033100 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (11ms) I0507 13:04:06.045686 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (13ms) I0507 13:04:06.057670 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (12ms) I0507 13:04:06.068573 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (11ms) I0507 13:04:06.079235 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (11ms) I0507 13:04:06.089763 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (11ms) I0507 13:04:06.100176 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (10ms) I0507 13:04:06.110844 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (11ms) I0507 13:04:06.180198 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (69ms) I0507 13:04:06.281116 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (101ms) I0507 13:04:06.380425 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (99ms) I0507 13:04:06.479523 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (99ms) I0507 13:04:06.580157 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms) I0507 13:04:06.684451 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (104ms) I0507 13:04:06.780648 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (96ms) I0507 13:04:06.881725 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (101ms) I0507 13:04:06.987801 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (106ms) I0507 13:04:07.085040 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (97ms) I0507 13:04:07.194368 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (109ms) I0507 13:04:07.279973 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (86ms) I0507 13:04:07.380460 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0507 13:04:07.482127 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (102ms) I0507 13:04:07.581060 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (99ms) I0507 13:04:07.680251 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (99ms) I0507 13:04:07.780193 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (100ms) I0507 13:04:07.880536 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (100ms) I0507 13:04:07.982155 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (102ms) I0507 13:04:08.080826 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (99ms) I0507 13:04:08.181241 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0507 13:04:08.280483 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (99ms) I0507 13:04:08.379795 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (99ms) I0507 13:04:08.482079 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (102ms) I0507 13:04:08.581755 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0507 13:04:08.684054 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (102ms) I0507 13:04:08.781503 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (97ms) I0507 13:04:08.879944 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (98ms) I0507 13:04:08.980320 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0507 13:04:09.079594 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (99ms) I0507 13:04:09.180864 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (101ms) I0507 13:04:09.282341 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (101ms) I0507 13:04:09.380585 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (98ms) I0507 13:04:09.481372 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (101ms) I0507 13:04:09.580876 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0507 13:04:09.680048 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (99ms) I0507 13:04:09.780197 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (100ms) I0507 13:04:09.780228 1 tasks_processing.go:74] worker 1 stopped. E0507 13:04:09.780238 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: received unexpected status code 500 Internal Server Error from https://10.128.0.13:8443/gather_runtime_info I0507 13:04:09.780517 1 recorder.go:75] Recording config/workload_info with fingerprint=4a1098a22ec81ba06d9b7b817891cc331819e058ac22d3a3b7068f5c08e3c4ed I0507 13:04:09.780532 1 gather.go:177] gatherer "workloads" function "workload_info" took 8.430815644s to process 1 records E0507 13:04:09.780556 1 periodic.go:247] "Unhandled Error" err="workloads failed after 8.431s with: function \"workload_info\" failed with an error" I0507 13:04:09.781659 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0507 13:04:09.781673 1 periodic.go:209] Running conditional gatherer I0507 13:04:09.789054 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0507 13:04:09.969565 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0507 13:04:11.040419 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0507 13:04:11.053666 1 conditional_gatherer.go:392] cluster version is '4.20.8' I0507 13:04:11.053695 1 tasks_processing.go:45] number of workers: 3 I0507 13:04:11.053704 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 13:04:11.053708 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0507 13:04:11.053717 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 13:04:11.053746 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 13:04:11.053754 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0507 13:04:11.053758 1 tasks_processing.go:74] worker 1 stopped. I0507 13:04:11.053772 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0507 13:04:11.053802 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0507 13:04:11.053814 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 880ns to process 1 records I0507 13:04:11.053847 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0507 13:04:11.053856 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.119µs to process 1 records I0507 13:04:11.053861 1 tasks_processing.go:74] worker 0 stopped. I0507 13:04:11.054055 1 tasks_processing.go:74] worker 2 stopped. I0507 13:04:11.054076 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 261.789µs to process 0 records I0507 13:04:11.054104 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0507 13:04:11.054124 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0507 13:04:11.091619 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=858024786383b789c3a11d062239ea30fa286ddf43b95835ab33a9cd5b6192f9 I0507 13:04:11.091770 1 diskrecorder.go:70] Writing 111 records to /var/lib/insights-operator/insights-2026-05-07-130411.tar.gz I0507 13:04:11.098140 1 diskrecorder.go:51] Wrote 111 records to disk in 6ms I0507 13:04:11.098168 1 periodic.go:278] Gathering cluster info every 2h0m0s I0507 13:04:11.098182 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0507 13:05:17.739939 1 diskrecorder.go:223] Found files to send: insights-2026-05-07-130411.tar.gz I0507 13:05:17.739970 1 insightsuploader.go:150] Checking archives to upload periodically every 15m57.052381252s I0507 13:05:17.739979 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0507 13:05:17.753500 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0507 13:05:17.930054 1 requests.go:87] Successfully reported id=2026-05-07T13:05:17Z x-rh-insights-request-id=fec56c10238e49788be31c2dde3c08e8, wrote=48277 I0507 13:05:17.930107 1 insightsuploader.go:187] Uploaded report successfully in 190.119297ms I0507 13:05:17.930128 1 controller.go:128] Initializing last reported time to 2026-05-07T13:05:17Z I0507 13:05:17.930137 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0507 13:05:17.930143 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0507 13:05:17.930150 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0507 13:05:17.938188 1 controller.go:512] The operator is healthy I0507 13:05:47.757254 1 controller.go:512] The operator is healthy I0507 13:06:18.790914 1 insightsreport.go:137] Pulling report from smart-proxy I0507 13:06:18.790939 1 insightsreport.go:149] Retrieving report I0507 13:06:18.799669 1 requests.go:110] Retrieving report for cluster: 8ff043ab-16b7-44da-a975-09f3d612dea6 I0507 13:06:18.799683 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8ff043ab-16b7-44da-a975-09f3d612dea6/reports I0507 13:06:18.802505 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8ff043ab-16b7-44da-a975-09f3d612dea6/reports I0507 13:06:19.076295 1 insightsreport.go:184] Report retrieved I0507 13:06:19.104204 1 insightsreport.go:239] Report retrieved correctly I0507 13:07:47.757511 1 controller.go:512] The operator is healthy I0507 13:08:47.726212 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 13:08:47.733402 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:08:47.733422 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 13:08:47.738812 1 secretconfigobserver.go:119] support secret does not exist I0507 13:09:47.759552 1 controller.go:512] The operator is healthy I0507 13:11:47.775255 1 controller.go:512] The operator is healthy I0507 13:13:47.721456 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:13:47.739532 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 13:13:47.745774 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:13:47.745793 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 13:13:47.751261 1 secretconfigobserver.go:119] support secret does not exist I0507 13:13:47.755240 1 controller.go:512] The operator is healthy I0507 13:15:47.757868 1 controller.go:512] The operator is healthy I0507 13:17:47.761418 1 controller.go:512] The operator is healthy I0507 13:18:47.751349 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 13:18:47.758077 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:18:47.758096 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 13:18:47.763355 1 secretconfigobserver.go:119] support secret does not exist I0507 13:19:47.760620 1 controller.go:512] The operator is healthy I0507 13:21:19.983693 1 insightsuploader.go:146] Nothing to report since 2026-05-07T13:05:17Z I0507 13:21:47.759800 1 controller.go:512] The operator is healthy I0507 13:23:47.726214 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:23:47.731882 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:23:47.755849 1 controller.go:512] The operator is healthy I0507 13:23:47.763672 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 13:23:47.770902 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:23:47.770920 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 13:23:47.776283 1 secretconfigobserver.go:119] support secret does not exist I0507 13:25:47.761208 1 controller.go:512] The operator is healthy I0507 13:27:47.760473 1 controller.go:512] The operator is healthy I0507 13:28:47.776632 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 13:28:47.785002 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:28:47.785022 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 13:28:47.790651 1 secretconfigobserver.go:119] support secret does not exist I0507 13:29:47.759771 1 controller.go:512] The operator is healthy I0507 13:31:47.756248 1 controller.go:512] The operator is healthy I0507 13:33:47.726301 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:33:47.756035 1 controller.go:512] The operator is healthy I0507 13:33:47.791123 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 13:33:47.797190 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:33:47.797206 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 13:33:47.802873 1 secretconfigobserver.go:119] support secret does not exist I0507 13:35:47.757404 1 controller.go:512] The operator is healthy I0507 13:37:47.757081 1 controller.go:512] The operator is healthy I0507 13:37:50.660239 1 insightsuploader.go:146] Nothing to report since 2026-05-07T13:05:17Z I0507 13:38:47.803623 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 13:38:47.814246 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:38:47.814267 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 13:38:47.819552 1 secretconfigobserver.go:119] support secret does not exist I0507 13:39:47.761392 1 controller.go:512] The operator is healthy I0507 13:41:47.760240 1 controller.go:512] The operator is healthy I0507 13:43:47.727332 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:43:47.756196 1 controller.go:512] The operator is healthy I0507 13:43:47.820221 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 13:43:47.826066 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:43:47.826081 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 13:43:47.831313 1 secretconfigobserver.go:119] support secret does not exist I0507 13:45:47.760873 1 controller.go:512] The operator is healthy