I0331 03:56:10.362786 1 cmd.go:253] Using service-serving-cert provided certificates I0331 03:56:10.363190 1 observer_polling.go:159] Starting file observer I0331 03:56:11.128089 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0331 03:56:11.128611 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0331 03:56:11.129540 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0331 03:56:11.129808 1 secure_serving.go:57] Forcing use of http/1.1 only W0331 03:56:11.129834 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0331 03:56:11.129840 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0331 03:56:11.129844 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0331 03:56:11.129847 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0331 03:56:11.129849 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0331 03:56:11.129851 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0331 03:56:11.134107 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0331 03:56:11.134135 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"16047e5a-8051-44d7-9219-cc86967f3729", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0331 03:56:11.135063 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0331 03:56:11.135081 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0331 03:56:11.135111 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0331 03:56:11.135124 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0331 03:56:11.135122 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0331 03:56:11.135133 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0331 03:56:11.135403 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0331 03:56:11.135672 1 secure_serving.go:213] Serving securely on [::]:8443 I0331 03:56:11.135700 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0331 03:56:11.139098 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0331 03:56:11.139122 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0331 03:56:11.139234 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0331 03:56:11.144561 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 03:56:11.144578 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0331 03:56:11.151665 1 secretconfigobserver.go:119] support secret does not exist I0331 03:56:11.156733 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 03:56:11.161927 1 secretconfigobserver.go:119] support secret does not exist I0331 03:56:11.164797 1 recorder.go:176] Pruning old reports every 7h30m42s, max age is 288h0m0s I0331 03:56:11.169892 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0331 03:56:11.169910 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0331 03:56:11.169914 1 periodic.go:216] Running clusterconfig gatherer I0331 03:56:11.169913 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0331 03:56:11.169930 1 insightsreport.go:296] Starting report retriever I0331 03:56:11.169936 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0331 03:56:11.169952 1 tasks_processing.go:45] number of workers: 64 I0331 03:56:11.169978 1 tasks_processing.go:69] worker 7 listening for tasks. I0331 03:56:11.169985 1 tasks_processing.go:69] worker 3 listening for tasks. I0331 03:56:11.169987 1 tasks_processing.go:69] worker 4 listening for tasks. I0331 03:56:11.169992 1 tasks_processing.go:69] worker 5 listening for tasks. I0331 03:56:11.169994 1 tasks_processing.go:71] worker 3 working on certificate_signing_requests task. I0331 03:56:11.169999 1 tasks_processing.go:69] worker 6 listening for tasks. I0331 03:56:11.170001 1 tasks_processing.go:69] worker 8 listening for tasks. I0331 03:56:11.170008 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 03:56:11.170010 1 tasks_processing.go:71] worker 8 working on pod_network_connectivity_checks task. I0331 03:56:11.170016 1 tasks_processing.go:69] worker 9 listening for tasks. I0331 03:56:11.170017 1 tasks_processing.go:69] worker 2 listening for tasks. I0331 03:56:11.170016 1 tasks_processing.go:69] worker 44 listening for tasks. I0331 03:56:11.170025 1 tasks_processing.go:69] worker 31 listening for tasks. I0331 03:56:11.170022 1 tasks_processing.go:69] worker 10 listening for tasks. I0331 03:56:11.170018 1 tasks_processing.go:69] worker 34 listening for tasks. I0331 03:56:11.170031 1 tasks_processing.go:69] worker 30 listening for tasks. I0331 03:56:11.169993 1 tasks_processing.go:69] worker 24 listening for tasks. I0331 03:56:11.170003 1 tasks_processing.go:71] worker 6 working on image_registries task. I0331 03:56:11.170042 1 tasks_processing.go:69] worker 14 listening for tasks. I0331 03:56:11.170043 1 tasks_processing.go:69] worker 36 listening for tasks. I0331 03:56:11.170042 1 tasks_processing.go:69] worker 33 listening for tasks. I0331 03:56:11.170049 1 tasks_processing.go:69] worker 15 listening for tasks. I0331 03:56:11.170050 1 tasks_processing.go:69] worker 27 listening for tasks. I0331 03:56:11.170057 1 tasks_processing.go:69] worker 18 listening for tasks. I0331 03:56:11.170057 1 tasks_processing.go:69] worker 25 listening for tasks. I0331 03:56:11.170048 1 tasks_processing.go:69] worker 54 listening for tasks. I0331 03:56:11.170065 1 tasks_processing.go:69] worker 28 listening for tasks. I0331 03:56:11.170066 1 tasks_processing.go:69] worker 17 listening for tasks. I0331 03:56:11.170052 1 tasks_processing.go:69] worker 37 listening for tasks. I0331 03:56:11.170035 1 tasks_processing.go:69] worker 29 listening for tasks. I0331 03:56:11.170028 1 tasks_processing.go:69] worker 11 listening for tasks. I0331 03:56:11.170076 1 tasks_processing.go:69] worker 19 listening for tasks. I0331 03:56:11.170078 1 tasks_processing.go:69] worker 40 listening for tasks. I0331 03:56:11.170067 1 tasks_processing.go:69] worker 26 listening for tasks. I0331 03:56:11.170083 1 tasks_processing.go:69] worker 21 listening for tasks. I0331 03:56:11.170081 1 tasks_processing.go:69] worker 23 listening for tasks. I0331 03:56:11.170088 1 tasks_processing.go:69] worker 22 listening for tasks. I0331 03:56:11.170087 1 tasks_processing.go:69] worker 42 listening for tasks. I0331 03:56:11.170033 1 tasks_processing.go:69] worker 32 listening for tasks. I0331 03:56:11.170100 1 tasks_processing.go:69] worker 55 listening for tasks. I0331 03:56:11.170104 1 tasks_processing.go:71] worker 7 working on authentication task. I0331 03:56:11.170099 1 tasks_processing.go:69] worker 63 listening for tasks. I0331 03:56:11.170010 1 tasks_processing.go:69] worker 16 listening for tasks. I0331 03:56:11.170112 1 tasks_processing.go:69] worker 52 listening for tasks. I0331 03:56:11.170111 1 tasks_processing.go:69] worker 50 listening for tasks. I0331 03:56:11.170113 1 tasks_processing.go:71] worker 1 working on ingress task. I0331 03:56:11.170122 1 tasks_processing.go:71] worker 44 working on mutating_webhook_configurations task. I0331 03:56:11.170124 1 tasks_processing.go:71] worker 27 working on jaegers task. I0331 03:56:11.170123 1 tasks_processing.go:71] worker 9 working on validating_webhook_configurations task. I0331 03:56:11.170116 1 tasks_processing.go:69] worker 58 listening for tasks. I0331 03:56:11.170123 1 tasks_processing.go:69] worker 51 listening for tasks. I0331 03:56:11.170135 1 tasks_processing.go:71] worker 54 working on tsdb_status task. I0331 03:56:11.170140 1 tasks_processing.go:71] worker 28 working on config_maps task. I0331 03:56:11.170142 1 tasks_processing.go:71] worker 24 working on silenced_alerts task. I0331 03:56:11.170143 1 tasks_processing.go:71] worker 18 working on storage_cluster task. I0331 03:56:11.170137 1 tasks_processing.go:71] worker 25 working on machine_config_pools task. I0331 03:56:11.170146 1 tasks_processing.go:71] worker 51 working on clusterroles task. I0331 03:56:11.169999 1 tasks_processing.go:71] worker 5 working on openshift_logging task. I0331 03:56:11.170003 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 03:56:11.170125 1 tasks_processing.go:71] worker 36 working on olm_operators task. I0331 03:56:11.170215 1 tasks_processing.go:71] worker 14 working on nodenetworkstates task. I0331 03:56:11.170220 1 tasks_processing.go:71] worker 22 working on openshift_machine_api_events task. I0331 03:56:11.170227 1 tasks_processing.go:71] worker 29 working on openstack_dataplanenodesets task. I0331 03:56:11.170229 1 tasks_processing.go:71] worker 32 working on image_pruners task. I0331 03:56:11.170060 1 tasks_processing.go:69] worker 38 listening for tasks. I0331 03:56:11.170318 1 tasks_processing.go:71] worker 19 working on image task. I0331 03:56:11.170139 1 tasks_processing.go:71] worker 58 working on service_accounts task. I0331 03:56:11.170071 1 tasks_processing.go:69] worker 41 listening for tasks. I0331 03:56:11.170462 1 tasks_processing.go:71] worker 41 working on openstack_controlplanes task. I0331 03:56:11.170075 1 tasks_processing.go:69] worker 45 listening for tasks. I0331 03:56:11.170082 1 tasks_processing.go:69] worker 46 listening for tasks. I0331 03:56:11.169995 1 tasks_processing.go:71] worker 4 working on machines task. I0331 03:56:11.170079 1 tasks_processing.go:69] worker 43 listening for tasks. I0331 03:56:11.170033 1 tasks_processing.go:69] worker 12 listening for tasks. I0331 03:56:11.170089 1 tasks_processing.go:69] worker 59 listening for tasks. I0331 03:56:11.170089 1 tasks_processing.go:69] worker 47 listening for tasks. I0331 03:56:11.170092 1 tasks_processing.go:69] worker 60 listening for tasks. I0331 03:56:11.170092 1 tasks_processing.go:69] worker 56 listening for tasks. I0331 03:56:11.170097 1 tasks_processing.go:69] worker 48 listening for tasks. I0331 03:56:11.170096 1 tasks_processing.go:69] worker 57 listening for tasks. I0331 03:56:11.170098 1 tasks_processing.go:69] worker 20 listening for tasks. I0331 03:56:11.170098 1 tasks_processing.go:69] worker 62 listening for tasks. I0331 03:56:11.170590 1 tasks_processing.go:71] worker 20 working on feature_gates task. I0331 03:56:11.170597 1 tasks_processing.go:71] worker 56 working on dvo_metrics task. I0331 03:56:11.170601 1 tasks_processing.go:71] worker 46 working on aggregated_monitoring_cr_names task. I0331 03:56:11.170618 1 tasks_processing.go:71] worker 48 working on overlapping_namespace_uids task. I0331 03:56:11.170625 1 tasks_processing.go:71] worker 43 working on container_runtime_configs task. I0331 03:56:11.170597 1 tasks_processing.go:71] worker 45 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0331 03:56:11.170647 1 tasks_processing.go:71] worker 57 working on infrastructures task. I0331 03:56:11.170643 1 tasks_processing.go:71] worker 12 working on nodes task. I0331 03:56:11.170664 1 tasks_processing.go:71] worker 47 working on container_images task. I0331 03:56:11.170592 1 tasks_processing.go:71] worker 62 working on pdbs task. I0331 03:56:11.170698 1 tasks_processing.go:71] worker 60 working on crds task. I0331 03:56:11.170116 1 tasks_processing.go:71] worker 31 working on support_secret task. I0331 03:56:11.170100 1 tasks_processing.go:69] worker 61 listening for tasks. I0331 03:56:11.170128 1 tasks_processing.go:71] worker 50 working on openstack_dataplanedeployments task. I0331 03:56:11.170833 1 tasks_processing.go:71] worker 61 working on install_plans task. I0331 03:56:11.170118 1 tasks_processing.go:71] worker 2 working on nodenetworkconfigurationpolicies task. I0331 03:56:11.170112 1 tasks_processing.go:69] worker 53 listening for tasks. I0331 03:56:11.170135 1 tasks_processing.go:71] worker 34 working on cluster_apiserver task. I0331 03:56:11.170130 1 tasks_processing.go:71] worker 10 working on metrics task. I0331 03:56:11.170138 1 tasks_processing.go:71] worker 30 working on operators_pods_and_events task. I0331 03:56:11.170213 1 tasks_processing.go:71] worker 0 working on machine_sets task. I0331 03:56:11.170037 1 tasks_processing.go:69] worker 35 listening for tasks. I0331 03:56:11.171156 1 tasks_processing.go:71] worker 35 working on schedulers task. I0331 03:56:11.170218 1 tasks_processing.go:71] worker 17 working on sap_datahubs task. I0331 03:56:11.170223 1 tasks_processing.go:71] worker 37 working on oauths task. I0331 03:56:11.170306 1 tasks_processing.go:71] worker 23 working on active_alerts task. I0331 03:56:11.170293 1 tasks_processing.go:71] worker 42 working on machine_autoscalers task. I0331 03:56:11.170319 1 tasks_processing.go:71] worker 11 working on sap_pods task. I0331 03:56:11.170330 1 tasks_processing.go:71] worker 38 working on machine_configs task. I0331 03:56:11.170330 1 tasks_processing.go:71] worker 40 working on qemu_kubevirt_launcher_logs task. I0331 03:56:11.170336 1 tasks_processing.go:71] worker 26 working on lokistack task. I0331 03:56:11.170348 1 tasks_processing.go:71] worker 33 working on operators task. I0331 03:56:11.170350 1 tasks_processing.go:71] worker 55 working on storage_classes task. I0331 03:56:11.170037 1 tasks_processing.go:69] worker 13 listening for tasks. I0331 03:56:11.171599 1 tasks_processing.go:71] worker 13 working on node_logs task. I0331 03:56:11.170354 1 tasks_processing.go:71] worker 15 working on cost_management_metrics_configs task. I0331 03:56:11.170362 1 tasks_processing.go:71] worker 63 working on version task. I0331 03:56:11.170361 1 tasks_processing.go:71] worker 16 working on ingress_certificates task. I0331 03:56:11.170365 1 tasks_processing.go:71] worker 52 working on ceph_cluster task. I0331 03:56:11.170071 1 tasks_processing.go:69] worker 39 listening for tasks. I0331 03:56:11.170103 1 tasks_processing.go:69] worker 49 listening for tasks. I0331 03:56:11.171969 1 tasks_processing.go:71] worker 49 working on proxies task. I0331 03:56:11.170593 1 tasks_processing.go:71] worker 59 working on sap_config task. I0331 03:56:11.170135 1 tasks_processing.go:71] worker 21 working on machine_healthchecks task. I0331 03:56:11.170999 1 tasks_processing.go:71] worker 53 working on openstack_version task. I0331 03:56:11.171954 1 tasks_processing.go:71] worker 39 working on node_features task. I0331 03:56:11.173936 1 tasks_processing.go:71] worker 8 working on networks task. E0331 03:56:11.173940 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0331 03:56:11.173976 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 3.917871ms to process 0 records E0331 03:56:11.175595 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.190.89:9091: connect: connection refused E0331 03:56:11.175605 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.121.153:9094: connect: connection refused I0331 03:56:11.175624 1 tasks_processing.go:71] worker 54 working on monitoring_persistent_volumes task. E0331 03:56:11.175632 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.190.89:9091: connect: connection refused E0331 03:56:11.175642 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.121.153:9094: connect: connection refused I0331 03:56:11.175655 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 5.472428ms to process 0 records E0331 03:56:11.175667 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.121.153:9094: connect: connection refused E0331 03:56:11.175657 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.190.89:9091: connect: connection refused I0331 03:56:11.175675 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 5.469825ms to process 0 records E0331 03:56:11.175697 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.121.153:9094: connect: connection refused I0331 03:56:11.175716 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 4.323542ms to process 0 records I0331 03:56:11.175720 1 tasks_processing.go:74] worker 24 stopped. I0331 03:56:11.175729 1 tasks_processing.go:74] worker 23 stopped. E0331 03:56:11.175730 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.190.89:9091: connect: connection refused I0331 03:56:11.175751 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 4.657616ms to process 0 records I0331 03:56:11.175772 1 tasks_processing.go:74] worker 10 stopped. I0331 03:56:11.176866 1 tasks_processing.go:74] worker 18 stopped. I0331 03:56:11.176876 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 6.711847ms to process 0 records I0331 03:56:11.176884 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 6.700187ms to process 0 records I0331 03:56:11.176891 1 tasks_processing.go:74] worker 5 stopped. I0331 03:56:11.176892 1 tasks_processing.go:74] worker 25 stopped. I0331 03:56:11.176901 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 6.73379ms to process 0 records I0331 03:56:11.176910 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 6.657283ms to process 0 records I0331 03:56:11.176918 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 6.763878ms to process 0 records I0331 03:56:11.176927 1 tasks_processing.go:74] worker 27 stopped. I0331 03:56:11.176933 1 tasks_processing.go:74] worker 29 stopped. I0331 03:56:11.187528 1 tasks_processing.go:74] worker 14 stopped. I0331 03:56:11.187546 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 17.2996ms to process 0 records I0331 03:56:11.187558 1 tasks_processing.go:74] worker 41 stopped. I0331 03:56:11.187570 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 17.072823ms to process 0 records I0331 03:56:11.187626 1 tasks_processing.go:74] worker 43 stopped. E0331 03:56:11.187627 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0331 03:56:11.187646 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 16.984173ms to process 0 records I0331 03:56:11.187659 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 16.228545ms to process 0 records I0331 03:56:11.187666 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 14.705947ms to process 0 records I0331 03:56:11.187674 1 tasks_processing.go:74] worker 39 stopped. I0331 03:56:11.187680 1 tasks_processing.go:74] worker 11 stopped. I0331 03:56:11.187689 1 tasks_processing.go:74] worker 59 stopped. I0331 03:56:11.187698 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 15.2015ms to process 0 records I0331 03:56:11.187707 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 16.855635ms to process 0 records I0331 03:56:11.187714 1 tasks_processing.go:74] worker 50 stopped. I0331 03:56:11.187716 1 tasks_processing.go:74] worker 2 stopped. I0331 03:56:11.187722 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 16.841053ms to process 0 records I0331 03:56:11.187752 1 tasks_processing.go:74] worker 52 stopped. I0331 03:56:11.187767 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 15.87139ms to process 0 records I0331 03:56:11.187782 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 16.151951ms to process 0 records I0331 03:56:11.187787 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 14.898426ms to process 0 records I0331 03:56:11.187793 1 tasks_processing.go:74] worker 15 stopped. I0331 03:56:11.187793 1 tasks_processing.go:74] worker 53 stopped. I0331 03:56:11.187814 1 tasks_processing.go:74] worker 21 stopped. E0331 03:56:11.187823 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0331 03:56:11.187832 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 15.020305ms to process 0 records E0331 03:56:11.187838 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0331 03:56:11.187845 1 gather.go:177] gatherer "clusterconfig" function "machines" took 17.315637ms to process 0 records I0331 03:56:11.187851 1 tasks_processing.go:74] worker 4 stopped. I0331 03:56:11.187990 1 tasks_processing.go:74] worker 1 stopped. I0331 03:56:11.188014 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0331 03:56:11.188030 1 controller.go:368] The initial operator extension status is healthy I0331 03:56:11.188043 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 03:56:11.188047 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 03:56:11.188049 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 03:56:11.188063 1 controller.go:531] The operator is still being initialized I0331 03:56:11.188071 1 controller.go:554] The operator is healthy I0331 03:56:11.188136 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0331 03:56:11.188247 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0331 03:56:11.188261 1 operator.go:328] started I0331 03:56:11.188279 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0331 03:56:11.188320 1 recorder.go:75] Recording config/ingress with fingerprint=bb8c06bd1619a7b8f502045d926bbb697e6fbedcf6cb31bf73e4e5b29cdda3b2 I0331 03:56:11.188342 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 17.853461ms to process 1 records I0331 03:56:11.188437 1 tasks_processing.go:74] worker 7 stopped. I0331 03:56:11.188579 1 recorder.go:75] Recording config/authentication with fingerprint=7ed8c9fa82b27df28c08dfc99b3b15f42314542995d27d9ac3558444b78d2f94 I0331 03:56:11.188592 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 17.88254ms to process 1 records I0331 03:56:11.194606 1 tasks_processing.go:74] worker 42 stopped. I0331 03:56:11.194623 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 23.238547ms to process 0 records I0331 03:56:11.194654 1 tasks_processing.go:74] worker 17 stopped. I0331 03:56:11.194668 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 23.483685ms to process 0 records I0331 03:56:11.194699 1 tasks_processing.go:74] worker 0 stopped. I0331 03:56:11.194713 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 23.612952ms to process 0 records I0331 03:56:11.194723 1 tasks_processing.go:74] worker 26 stopped. I0331 03:56:11.194735 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 23.18242ms to process 0 records I0331 03:56:11.194936 1 tasks_processing.go:74] worker 20 stopped. I0331 03:56:11.195086 1 recorder.go:75] Recording config/featuregate with fingerprint=94fb9a381b6624e2c0c61a52460bf169fecb7c4107992f04d065cfa743ed7751 I0331 03:56:11.195105 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 24.335033ms to process 1 records I0331 03:56:11.195284 1 tasks_processing.go:74] worker 8 stopped. I0331 03:56:11.195428 1 recorder.go:75] Recording config/network with fingerprint=72cb479a292f01eba18a09dd48c31bfc3b56036315beb366c78aeab1a0411927 I0331 03:56:11.195442 1 gather.go:177] gatherer "clusterconfig" function "networks" took 21.331086ms to process 1 records I0331 03:56:11.195831 1 tasks_processing.go:74] worker 57 stopped. I0331 03:56:11.196329 1 recorder.go:75] Recording config/infrastructure with fingerprint=254a624317527c236242c329d3102958fb1efceea8251e129352dd102e11b8e7 I0331 03:56:11.196343 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 25.168752ms to process 1 records I0331 03:56:11.196666 1 tasks_processing.go:74] worker 49 stopped. I0331 03:56:11.196740 1 recorder.go:75] Recording config/proxy with fingerprint=e41bb00abb9ad90f5eda2f76d065ecbb2f282b4775e5bab28e620577e7a8400c I0331 03:56:11.196757 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 24.482059ms to process 1 records I0331 03:56:11.196922 1 tasks_processing.go:74] worker 32 stopped. I0331 03:56:11.197159 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=64ef45b72927fa61142ba4cd094cc8f3e7db18114e6df49c471ff53e5c58cf99 I0331 03:56:11.197174 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 26.675869ms to process 1 records I0331 03:56:11.202228 1 tasks_processing.go:74] worker 22 stopped. I0331 03:56:11.202244 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 31.989372ms to process 0 records I0331 03:56:11.202348 1 tasks_processing.go:74] worker 19 stopped. I0331 03:56:11.202458 1 recorder.go:75] Recording config/image with fingerprint=1b44cdae571bdbc51b22d1871f4e9dccbf8982f9defd060ae5a4b78715e56953 I0331 03:56:11.202477 1 gather.go:177] gatherer "clusterconfig" function "image" took 31.963084ms to process 1 records I0331 03:56:11.202525 1 tasks_processing.go:74] worker 31 stopped. E0331 03:56:11.202538 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0331 03:56:11.202546 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 31.703155ms to process 0 records I0331 03:56:11.202853 1 tasks_processing.go:74] worker 9 stopped. I0331 03:56:11.203542 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=d3b845ea6dcd5afa3f09b6dd7fa5f3651acb5a1760b8e045e1e446abeab015f9 I0331 03:56:11.203691 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=26f735f2340201924cfed71079b9b808234336721000833ffd3d0bd408e5c578 I0331 03:56:11.203851 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=c37fa85b5bcf79f8074c62fcbf40927b4d2fb3428404524934fefef99d5ca047 I0331 03:56:11.203912 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=bd84754ce138f580b96dba8bedff1ba802e5878659ce42b024c4edb11e3822b8 I0331 03:56:11.203969 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=f830804d1378b1895c1590a20ee090dd4835a676249b9a42be8d0ef58ddb91d7 I0331 03:56:11.204040 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=01056cbea6e4b4d8a23d30d0616a985c55e2304422a62041c2b24888a6503824 I0331 03:56:11.204099 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=af5f703bc7f1666ca61475d9ec115765de96490ba94adc95793c4dc87679c518 I0331 03:56:11.204172 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=25b572972f6c67edeec62f61bba33c958c34d716d964db3971f09ec0272c068c I0331 03:56:11.204272 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=4c696215ec55b2baac42f0ee7b3bc44e32edc86b3e1b75f5a376a13a6d2debef I0331 03:56:11.204374 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=78601d09bb89927900400442c13c57bd64841fa55cb8198b046f11d0707828db I0331 03:56:11.204466 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=0cdf2c169e3350f92c5d5e1b1e9ce56e76fec5bfafaa9e408a38d614bb0f80df I0331 03:56:11.204554 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=ea5319f4e26e8317219528058042df3683f56a4ef52fd6aa1947d4f215a5c2f7 I0331 03:56:11.204943 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=c0320e4c35c03ecd2a5631335400e1641fb15ed11d0013a7775608589abbb61d I0331 03:56:11.204965 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 32.71525ms to process 13 records I0331 03:56:11.205057 1 tasks_processing.go:74] worker 37 stopped. I0331 03:56:11.205253 1 recorder.go:75] Recording config/oauth with fingerprint=a27484f95c7a1c322643464878d137f57f4a547135a1ebbcafd8789d998291dd I0331 03:56:11.205270 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 31.694243ms to process 1 records I0331 03:56:11.205346 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=4d68d27b2c8d962f2c91be919e6f9ba777358a2dbbc8ba25959d2b95ff36bc8b I0331 03:56:11.205364 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=7430f67151b2b9c294e8f7290de33c342b47dcb4f8115b82e9dc5191b1eacf5b I0331 03:56:11.205383 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=5f8a428c335f93cedfc316beb2f89ca8de52cec1336afa215eda6ad08674ac76 I0331 03:56:11.205388 1 tasks_processing.go:74] worker 62 stopped. I0331 03:56:11.205404 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=76a39f17243e12c337f14e2ebc187bdbfc7ffd3efcd798e0ac0ce9856b7854e9 I0331 03:56:11.205419 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=9d3d3aaeaa802706d654d2834acb15ecce7c712063c055e93f73cc55718d0e68 I0331 03:56:11.205434 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=e77c17e55af238081685a346fa62ab78fe407a5f364cb4ff4f23079e9d68c214 I0331 03:56:11.205447 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=d8539f38d0f9f5769df9d8c649e3db8699c3040b8c909b1cb057d6a05bd09ab9 I0331 03:56:11.205476 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=de9b46ec6a37dc72b240057177b592cacc90957cecfbded937df0c3edb2bec2a I0331 03:56:11.205503 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=a7b38bb32919c9b1144c32272bafa76ff5c77d9d7f1352a88c4eca57e4bd1108 I0331 03:56:11.205525 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=ff3ba6a4de8ef6925cdd699528d469805c9ec60e41ac9ae39468e136ba8c30b3 I0331 03:56:11.205533 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 32.450913ms to process 10 records I0331 03:56:11.205542 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 29.582425ms to process 0 records E0331 03:56:11.205550 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0331 03:56:11.205590 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0331 03:56:11.205601 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 34.058348ms to process 1 records I0331 03:56:11.205608 1 tasks_processing.go:74] worker 54 stopped. I0331 03:56:11.205619 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0331 03:56:11.205619 1 tasks_processing.go:74] worker 38 stopped. I0331 03:56:11.205628 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 34.908076ms to process 1 records I0331 03:56:11.205638 1 tasks_processing.go:74] worker 48 stopped. I0331 03:56:11.205910 1 tasks_processing.go:74] worker 44 stopped. I0331 03:56:11.206063 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=129a723830cdb2b6f549482aa83dba92f164935183c3f3ac0100b1a7a1d11a3d I0331 03:56:11.206110 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=203421032629be59e76dbf849771dc02e53df583087d1cf9609f016b6e146603 I0331 03:56:11.206150 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=6d269d6557bd4137d6a5da03811502b28982519529646658ddcffc7c7e546c81 I0331 03:56:11.206163 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 35.773546ms to process 3 records I0331 03:56:11.206255 1 tasks_processing.go:74] worker 6 stopped. I0331 03:56:11.206532 1 gather_logs.go:145] no pods in namespace were found I0331 03:56:11.206686 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=6a6259e58fd2d9864b6d5ef57c699ebf5af49fe6560e8777cb0827e5e0fa391c I0331 03:56:11.206702 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 36.016221ms to process 1 records I0331 03:56:11.206782 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=25fd160b91f67a0f79c115378c81d7cbdb5a65e130e02cf6e65ad2c7539a9be4 I0331 03:56:11.206793 1 tasks_processing.go:74] worker 55 stopped. I0331 03:56:11.206802 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=8640915e7dc29d581cb3ee430546af9da80aa15e38e9cd2f440e06253c67db13 I0331 03:56:11.206811 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 34.888885ms to process 2 records I0331 03:56:11.206819 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 35.062783ms to process 0 records I0331 03:56:11.206826 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 34.964756ms to process 0 records I0331 03:56:11.206831 1 tasks_processing.go:74] worker 40 stopped. I0331 03:56:11.206844 1 tasks_processing.go:74] worker 13 stopped. I0331 03:56:11.206891 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=55a56d82754c769d09e9505ead11fe55f5e84e8acb4592b0bd138958dacf8fb2 I0331 03:56:11.206905 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 35.521906ms to process 1 records I0331 03:56:11.206914 1 tasks_processing.go:74] worker 35 stopped. I0331 03:56:11.207146 1 tasks_processing.go:74] worker 34 stopped. I0331 03:56:11.207338 1 recorder.go:75] Recording config/apiserver with fingerprint=bc03d6ba2a55c1bca60567ecdaf7865c1983c12066b5533e146b0c05b6923177 I0331 03:56:11.207357 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 36.201203ms to process 1 records I0331 03:56:11.207448 1 tasks_processing.go:74] worker 12 stopped. I0331 03:56:11.207714 1 recorder.go:75] Recording config/node/ip-10-0-0-60.ec2.internal with fingerprint=6bd69314ee4a9ac0d6bf3c4c57f279d0e4adf31b3fa6590ae62f49e960fae810 I0331 03:56:11.208354 1 recorder.go:75] Recording config/node/ip-10-0-1-138.ec2.internal with fingerprint=11a3304b8afa48a21d0ca06537acb2525b0d9d58b01c1b7c74d515fe2e7727d6 I0331 03:56:11.208556 1 recorder.go:75] Recording config/node/ip-10-0-2-188.ec2.internal with fingerprint=96c93dd7b16a6db7d5b95b6847c74faed250153806b0cfc098d493cf798d3ad2 I0331 03:56:11.208651 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 36.693358ms to process 3 records I0331 03:56:11.208648 1 controller.go:254] Source scaController *sca.Controller is not ready I0331 03:56:11.208688 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0331 03:56:11.208707 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 03:56:11.208712 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 03:56:11.208717 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 03:56:11.208797 1 tasks_processing.go:74] worker 51 stopped. I0331 03:56:11.208894 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b00563d72af653ef702f5c2ee23a2ac2633de3b78a161e603923b66a8cea8c4e I0331 03:56:11.209002 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=36e903809601a38897dca219092b29555e22af93b6cb824e7be2f74333630190 I0331 03:56:11.209015 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 38.390366ms to process 2 records I0331 03:56:11.209110 1 tasks_processing.go:74] worker 60 stopped. I0331 03:56:11.209178 1 controller.go:531] The operator is still being initialized I0331 03:56:11.209258 1 controller.go:554] The operator is healthy I0331 03:56:11.210145 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=3bd6d83c0705d7741030316c723130bee057d77d6a3e5846394b4df969c5b834 W0331 03:56:11.210696 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0331 03:56:11.211541 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=2c3ab2b538577301230885df0b4f67248c3dc9fe4f3186908da1338b466f21a9 I0331 03:56:11.211563 1 gather.go:177] gatherer "clusterconfig" function "crds" took 38.400991ms to process 2 records I0331 03:56:11.212060 1 tasks_processing.go:74] worker 30 stopped. I0331 03:56:11.212083 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 41.013858ms to process 0 records I0331 03:56:11.213394 1 tasks_processing.go:74] worker 3 stopped. I0331 03:56:11.213412 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 43.38696ms to process 0 records I0331 03:56:11.225757 1 tasks_processing.go:74] worker 36 stopped. I0331 03:56:11.225814 1 recorder.go:75] Recording config/olm_operators with fingerprint=48f3f5d64b858abf52c2e6513971fa070963bda8efc6b1a2c905247e5d7ae196 I0331 03:56:11.225827 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 55.526307ms to process 1 records I0331 03:56:11.231587 1 tasks_processing.go:74] worker 63 stopped. I0331 03:56:11.231843 1 recorder.go:75] Recording config/version with fingerprint=bac23f675dfe416ff6c2958608b7ff28ad4015b9052067ced861b14a089bb687 I0331 03:56:11.231859 1 recorder.go:75] Recording config/id with fingerprint=246fa5eabb59b5f76f057f10fba26f1e4f8f105a464dc1688246e95c63a610ef I0331 03:56:11.231868 1 gather.go:177] gatherer "clusterconfig" function "version" took 59.942268ms to process 2 records I0331 03:56:11.231908 1 tasks_processing.go:74] worker 46 stopped. I0331 03:56:11.231925 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 61.292168ms to process 0 records I0331 03:56:11.234792 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0331 03:56:11.235324 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0331 03:56:11.235325 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0331 03:56:11.235341 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0331 03:56:11.239264 1 base_controller.go:82] Caches are synced for ConfigController I0331 03:56:11.239280 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0331 03:56:11.246349 1 tasks_processing.go:74] worker 47 stopped. I0331 03:56:11.247609 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-8777bd9bb-xprbl with fingerprint=aa68e35d8d7d05ada359009924d39102d7aae7224deca025b48138ea9e449f9f I0331 03:56:11.247866 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-b4lgc with fingerprint=82940afaf5f4443dc61a9b7fe44821b2ab9a393ba5e8dc1d6dbd7c07b7384ea2 I0331 03:56:11.247943 1 recorder.go:75] Recording config/running_containers with fingerprint=13624e26037ae1b7abb9ae1eb0c61e3a03733713e53cf75cb82c0de23ea8ee06 I0331 03:56:11.247953 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 75.663844ms to process 3 records I0331 03:56:11.247964 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 75.956336ms to process 0 records I0331 03:56:11.247973 1 tasks_processing.go:74] worker 45 stopped. I0331 03:56:11.254545 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 03:56:11.255312 1 tasks_processing.go:74] worker 28 stopped. E0331 03:56:11.255332 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0331 03:56:11.255344 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0331 03:56:11.255350 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0331 03:56:11.255363 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=7c953bef0cdbddb25a47a3c40772dfa7cbf73ae2ac9bb3dc97984dbf1bd43499 I0331 03:56:11.255439 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0331 03:56:11.255474 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0331 03:56:11.255483 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=4bec6f0bfa45f0ccf5709371166150dcb9cf2703d04f5f6de4476d0277c477a6 I0331 03:56:11.255498 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0331 03:56:11.255559 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0331 03:56:11.255569 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0331 03:56:11.255577 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 85.15517ms to process 7 records I0331 03:56:11.288479 1 base_controller.go:82] Caches are synced for LoggingSyncer I0331 03:56:11.288494 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0331 03:56:11.296135 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0331 03:56:11.300382 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0331 03:56:11.321184 1 cluster_transfer.go:102] no available accepted cluster transfer I0331 03:56:11.321217 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0331 03:56:11.341719 1 tasks_processing.go:74] worker 16 stopped. E0331 03:56:11.341740 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0331 03:56:11.341749 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pcf4jph0npl5lb2s9sicapsrbqpq2gt-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pcf4jph0npl5lb2s9sicapsrbqpq2gt-primary-cert-bundle-secret" not found I0331 03:56:11.341825 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=6f9841dd32018f4daa46649d3ef8c62aeacc0ea80b1b2411d6bff5ca96bc4bbd I0331 03:56:11.341843 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 170.005773ms to process 1 records I0331 03:56:11.418284 1 sca.go:266] etc-pki-entitlement secret successfully created I0331 03:56:11.418300 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated W0331 03:56:12.209822 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0331 03:56:13.209580 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0331 03:56:13.642784 1 tasks_processing.go:74] worker 33 stopped. I0331 03:56:13.642911 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=2750454b28ba6f976c2f9045e8d3f1183c17c2a142af868a450fcf3bbf244839 I0331 03:56:13.642958 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0331 03:56:13.642993 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=c4f0f82b1d19d35a19a92ed7ffff27b0e55117f5bdc588729a159911618e7d38 I0331 03:56:13.643003 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0331 03:56:13.643024 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=3d49c335a08475039faeba426035a274f30fbaabfa32dba59bcd480e406eb132 I0331 03:56:13.643038 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0331 03:56:13.643067 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=02ec7dce01df8d025a833f6678a3cf1bde422f1229b25dcab2eda59b6407a65c I0331 03:56:13.643094 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=a6cecfe185f6f906dc0e07e1dd1fc816b36c989b24d3252ead2c55e90a474a92 I0331 03:56:13.643117 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=4a96ac14bcc9416a7dc8952d2ec9d878a34fe550881ec2d0d78cfbbc22b98c9b I0331 03:56:13.643144 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=1566b1be57982b2fbbf2d1ec638f6b1745467d5de148c0ed31c50ad5e94aa2e5 I0331 03:56:13.643471 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=179728fce0b025bd82b14bbf0867d21e436c43ea12b63d2f7669a2d287c8eb34 I0331 03:56:13.643496 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=5739f285b2c71036701dbe69529543180daee7eb2b6d33fc25f8e435b712ed5a I0331 03:56:13.643504 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0331 03:56:13.643520 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=9028241210aa98c75f1edbecd758997f5071446a51e7e7f4c6d823724fc319dc I0331 03:56:13.643532 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0331 03:56:13.643548 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=6aa7b93724823775794b9d6480d7ad45f664ba40d3ff398585d428fa6365450e I0331 03:56:13.643558 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0331 03:56:13.643577 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=2d509c0abded7893801f012e61927dfdadba2a5c2b91f0deb7eeaabdd6d07793 I0331 03:56:13.643586 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0331 03:56:13.643606 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=ec114d3268d0de473c9b61d8f4ab5981774ec6dcf587fd66ea27ac5b4f5e245e I0331 03:56:13.643709 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=9ce8417f10f82fc36d684d6560fea49d5b1b8af64611eda5a4abe227271c45a5 I0331 03:56:13.643728 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0331 03:56:13.643735 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0331 03:56:13.643757 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0331 03:56:13.643781 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=1b70b9aa14aca8584029a465ebd88c3d110942381e88a1dead15e094868dd003 I0331 03:56:13.643802 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=8ca0da774a56335a6492567b76867445020a5cd48f6010ddae19b674c4f927a5 I0331 03:56:13.643812 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0331 03:56:13.643828 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=e34eaf3985c99e396415a9203693af5e350d539f235417528c1e303799c4e43f I0331 03:56:13.643838 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0331 03:56:13.643854 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=78fba736d3c26d97d286d38dad9eed651058115816098f1c70e8728fc9bdfa30 I0331 03:56:13.643861 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0331 03:56:13.643874 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=87541f7a20ac63df75032960c51a5e19a9adf699e4feb9489f102ef8682ed86b I0331 03:56:13.643889 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=87e36fd512250f67917172ff6d3564a418dd4f1bc3119887a9608367843538c6 I0331 03:56:13.643902 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=f9d35aa4a637d04f036a35fb4a1efa38a99637e7d8dac2417a6f60f1f56a14cb I0331 03:56:13.643921 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=318fb186a587528249e235664db5b0a78c2dd3283baaf70e56335a24b20c59a0 I0331 03:56:13.643930 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0331 03:56:13.643957 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=afb7fb3a616e14879db6e3d4297245de14a7a4c84f7b25361cbaf6c13812e2bd I0331 03:56:13.643974 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0331 03:56:13.643981 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0331 03:56:13.643988 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.471201676s to process 39 records W0331 03:56:14.208862 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0331 03:56:15.210854 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0331 03:56:16.209960 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0331 03:56:16.209986 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0331 03:56:16.210002 1 tasks_processing.go:74] worker 56 stopped. E0331 03:56:16.210013 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0331 03:56:16.210026 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0331 03:56:16.210035 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.039393093s to process 1 records I0331 03:56:24.010154 1 tasks_processing.go:74] worker 61 stopped. I0331 03:56:24.010218 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0331 03:56:24.010231 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.839301682s to process 1 records I0331 03:56:24.776223 1 tasks_processing.go:74] worker 58 stopped. I0331 03:56:24.776529 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=168fffbb2ffe3e4223178b9929987b11ee2f64fe6f0ebe7873bbab778d18dbe6 I0331 03:56:24.776553 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605804538s to process 1 records E0331 03:56:24.776624 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.606s with: function \"pod_network_connectivity_checks\" failed with an error, function \"tsdb_status\" failed with an error, function \"silenced_alerts\" failed with an error, function \"active_alerts\" failed with an error, function \"metrics\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0331 03:56:24.777735 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "tsdb_status" failed with an error, function "silenced_alerts" failed with an error, function "active_alerts" failed with an error, function "metrics" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0331 03:56:24.777751 1 periodic.go:216] Running workloads gatherer I0331 03:56:24.777766 1 tasks_processing.go:45] number of workers: 2 I0331 03:56:24.777772 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 03:56:24.777775 1 tasks_processing.go:71] worker 1 working on workload_info task. I0331 03:56:24.777843 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 03:56:24.777914 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0331 03:56:24.783515 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-188.ec2.internal... I0331 03:56:24.783527 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-60.ec2.internal... I0331 03:56:24.783545 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-138.ec2.internal... I0331 03:56:24.801565 1 tasks_processing.go:74] worker 0 stopped. I0331 03:56:24.801587 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 23.631603ms to process 0 records I0331 03:56:29.267892 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s I0331 03:56:29.293669 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data I0331 03:56:29.301538 1 gather_workloads_info.go:387] No image sha256:0fd69333c121efd68919e731cd3ea01e976e00415bda6e987bf1e949ec224eda (9ms) I0331 03:56:29.310036 1 gather_workloads_info.go:387] No image sha256:72ae38682f25786aec18625cfed5d7831017d2f0f1304c3320c00ce0b7fb09c1 (8ms) I0331 03:56:29.319764 1 gather_workloads_info.go:387] No image sha256:273930332d7b481bbca4521cf740507498a2a323a4010cd66e896806b299f85e (10ms) I0331 03:56:29.327103 1 gather_workloads_info.go:387] No image sha256:6263faa8ef7759ec21f26df08314c5d64e52d967b49961cb9404c54532c03365 (7ms) I0331 03:56:29.334527 1 gather_workloads_info.go:387] No image sha256:31e175b644c6627779ca6b9f48d9426760dd449788ad671dd0277cce8fb822e8 (7ms) I0331 03:56:29.342438 1 gather_workloads_info.go:398] Found image sha256:70dcc3c7d3a572ecacc7c838fd17d07ff21531e50a7ed9227a17c27437151bf4 (8ms) I0331 03:56:29.349840 1 gather_workloads_info.go:387] No image sha256:8f72efd51f564d8d3e4ecee6555d7bd5394d0776054d2112febea6b7c9e71225 (7ms) I0331 03:56:29.356823 1 gather_workloads_info.go:387] No image sha256:a6b085cdad58db8529d99c22ec1ec79fe09ab00ab1c92ee38b29e7875dc0533c (7ms) I0331 03:56:29.363955 1 gather_workloads_info.go:387] No image sha256:44ceafe5147680d58a5c2d3720932b972e6bc9639faadc19aa6b360af154e1a3 (7ms) I0331 03:56:29.371250 1 gather_workloads_info.go:398] Found image sha256:1c5b548d67e5c56e3297b2f8aa34428e544b5b5ac88bd8d0f465760375c501e6 (7ms) I0331 03:56:29.401019 1 gather_workloads_info.go:387] No image sha256:5f852f6127d27e6fc071afe58d80024370467cb2476f4d9f077f8ebca8600918 (30ms) I0331 03:56:29.502236 1 gather_workloads_info.go:387] No image sha256:185a95b130b6a27ad88fcf39803215b7bd998472b1e37225858435f4eb7c3c04 (101ms) I0331 03:56:29.600845 1 gather_workloads_info.go:387] No image sha256:c59765325e6f286c067e555850b0d81f2de5e5ee8625ed83cdc2cea96f3a7ddb (99ms) I0331 03:56:29.701095 1 gather_workloads_info.go:387] No image sha256:2a07c1b2ef06bbfa3a491b84f7410e24de7cb487f49bbbb3bfd7cb3510c8429a (100ms) I0331 03:56:29.801984 1 gather_workloads_info.go:387] No image sha256:66640a3f7bd65090345552611701a73e74bc44897b9d29e43b11f73b96598ac0 (101ms) I0331 03:56:29.901816 1 gather_workloads_info.go:387] No image sha256:4e62a2dcb8214491388d4c17f89fe699eb53cdb8039dcba6ab052edc28da3fbd (100ms) I0331 03:56:30.001700 1 gather_workloads_info.go:387] No image sha256:07a6c0a310270b830b96fcb8fca9cd11e45569276335bb5334b18b388d6eed51 (100ms) I0331 03:56:30.102044 1 gather_workloads_info.go:387] No image sha256:1ad039a130515504a258952cb18e67c3329da5182bb0623cc0891e6c15e2113a (100ms) I0331 03:56:30.201645 1 gather_workloads_info.go:387] No image sha256:3e8d51b4b12d970bf561f67d0fcd9c0966a6d49866e6466daa341ee43d95d6e2 (100ms) I0331 03:56:30.301980 1 gather_workloads_info.go:387] No image sha256:e476b4dafff885727b0057259c9df67a68e196f8cd92c21db2e4efe84a5f7a25 (100ms) I0331 03:56:30.401855 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0331 03:56:30.502694 1 gather_workloads_info.go:387] No image sha256:cfcb0bd30c537e677ac6856c36c0c923b415f24d944c7aa1386489f511f6491d (101ms) I0331 03:56:30.602110 1 gather_workloads_info.go:387] No image sha256:2e3661304917ce7f3be49974faacc60c24cbe2833d7b50c8c205c2f3f2467950 (99ms) I0331 03:56:30.701787 1 gather_workloads_info.go:387] No image sha256:12448aad6e9050c2b2445035be818a490cef502d39b73dbd51cc0f5ea7d67d40 (100ms) I0331 03:56:30.802000 1 gather_workloads_info.go:387] No image sha256:14e983ca10e1033822e1c4be0a1e4a40762951a5d6e4a77bf642891f291d32ae (100ms) I0331 03:56:30.903563 1 gather_workloads_info.go:387] No image sha256:aa65d1c7fb8805b767fc4878faea280472f372010efadc66e5641a2e634a80c0 (102ms) I0331 03:56:31.001475 1 gather_workloads_info.go:387] No image sha256:3739c0c55f7f7ccc84309ae11eb23d3d9e5ad50a68e849a8a8dfda7f2f2bc137 (98ms) I0331 03:56:31.101296 1 gather_workloads_info.go:387] No image sha256:2ade6dfb5406ef3a4264dea95d455298f54e8ef4d458d9ee3e94c33d48676a9b (100ms) I0331 03:56:31.201871 1 gather_workloads_info.go:387] No image sha256:20a3e59566dd25058fff22e18569067fe6a12d8ac5ac62fa6508e0cee44d7897 (101ms) I0331 03:56:31.302882 1 gather_workloads_info.go:387] No image sha256:3b9f60077c475f2baad0dd51ffc9d469f3a9b54c474bb86a35f93cb9b8fdc734 (101ms) I0331 03:56:31.402179 1 gather_workloads_info.go:387] No image sha256:3da5a449ace61cb7d002d8e7911c14905c74cf58a296527458d1af0f1abf0a72 (99ms) I0331 03:56:31.501975 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (100ms) I0331 03:56:31.601859 1 gather_workloads_info.go:387] No image sha256:5b51a4d9d3b7ecad110fb6eb00f71e9e9b854067d79b220df397a58d9fa50eb0 (100ms) I0331 03:56:31.702703 1 gather_workloads_info.go:387] No image sha256:5bd409efe77c6a126418be2c098dde9431c1a290cec885a7e37c0c8ddc2337a8 (101ms) I0331 03:56:31.801354 1 gather_workloads_info.go:387] No image sha256:64dbe77583c8b23dc6852fc482ea5b4081490734944ec8b765d5450b3fdb30ed (99ms) I0331 03:56:31.902401 1 gather_workloads_info.go:387] No image sha256:4c39dc633bf3560c2397281b74faf9d00500b0738dec6c1aad2cc8ce326be6fc (101ms) I0331 03:56:32.001264 1 gather_workloads_info.go:387] No image sha256:12aec97ddeb527881acf5949bea2b227baa1dbfccf30679e8d57ff0b82e42707 (99ms) I0331 03:56:32.101345 1 gather_workloads_info.go:387] No image sha256:0e5fa2595714628c16cf590efd28715bde790d2dc6b3a793b2a38dfb3ffb591a (100ms) I0331 03:56:32.202369 1 gather_workloads_info.go:387] No image sha256:1e6d59867cbd750672bc9ccfb9c69c3d198174cd43dd6d71a0da358b4b766473 (101ms) I0331 03:56:32.301032 1 gather_workloads_info.go:387] No image sha256:87de118dc29ca1b47d4768ec5ed4441bc1dada3fb2a78d53b1833249baa86dd4 (99ms) I0331 03:56:32.402875 1 gather_workloads_info.go:387] No image sha256:51e1b5dc9fccbee5b7df78d0e8bbe379f75529232c102c9ed5b1ae134c4b9b4c (102ms) I0331 03:56:32.502086 1 gather_workloads_info.go:387] No image sha256:6ea0f19030ffc52a290e6eeb812ef2426c48a2f1083b1e415e0667998cbb7bf2 (99ms) I0331 03:56:32.602042 1 gather_workloads_info.go:387] No image sha256:1b58ba57c10e2ba03a0d8dba1f3f8faa866e1dca6170725b6909c2cc2b96efa6 (100ms) I0331 03:56:32.701560 1 gather_workloads_info.go:387] No image sha256:7e0a58aad44d5b09954f8261e3e428c8dfa076eb9c2b6ef46a91d27ac78ac17a (99ms) I0331 03:56:32.801463 1 gather_workloads_info.go:387] No image sha256:92a731e25801365be0ad0916bec5bf24b2035e443ad1414a1631d1e0473ddf77 (100ms) I0331 03:56:32.901551 1 gather_workloads_info.go:387] No image sha256:2f26472542da4f89a2ac34a93fd438d385419dda16811bdfa7e679e0115abe56 (100ms) I0331 03:56:33.001324 1 gather_workloads_info.go:387] No image sha256:ad0e262327997e8cdc4074a2373e67274d9b8a943aa274a2cd8ce98ffe1db4a0 (100ms) I0331 03:56:33.101302 1 gather_workloads_info.go:387] No image sha256:24929612f2f0f2d4cd3ac163c04bbf4ac64cc47d3d0eef81db085d00c59058bd (100ms) I0331 03:56:33.101337 1 tasks_processing.go:74] worker 1 stopped. E0331 03:56:33.101350 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: received unexpected status code 500 Internal Server Error from https://10.128.0.24:8443/gather_runtime_info I0331 03:56:33.101661 1 recorder.go:75] Recording config/workload_info with fingerprint=33379c62a3a2f0f02ffab06f3d09ed8b8ede5e14e197f362612289399c8d0b67 I0331 03:56:33.101678 1 gather.go:177] gatherer "workloads" function "workload_info" took 8.323552835s to process 1 records E0331 03:56:33.101702 1 periodic.go:254] "Unhandled Error" err="workloads failed after 8.323s with: function \"workload_info\" failed with an error" I0331 03:56:33.102814 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0331 03:56:33.102833 1 periodic.go:216] Running conditional gatherer I0331 03:56:33.107927 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.6/gathering_rules I0331 03:56:33.479531 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0331 03:56:33.481966 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.190.89:9091: connect: connection refused I0331 03:56:33.482045 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0331 03:56:33.487594 1 conditional_gatherer.go:392] cluster version is '4.21.6' E0331 03:56:33.487609 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487614 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487617 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487620 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487623 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487626 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487629 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487632 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487634 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0331 03:56:33.487637 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0331 03:56:33.487650 1 tasks_processing.go:45] number of workers: 3 I0331 03:56:33.487660 1 tasks_processing.go:69] worker 2 listening for tasks. I0331 03:56:33.487666 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0331 03:56:33.487674 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 03:56:33.487682 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 03:56:33.487696 1 tasks_processing.go:74] worker 1 stopped. I0331 03:56:33.487696 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0331 03:56:33.487714 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0331 03:56:33.487738 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0331 03:56:33.487753 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.036µs to process 1 records I0331 03:56:33.487785 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0331 03:56:33.487794 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.452µs to process 1 records I0331 03:56:33.487799 1 tasks_processing.go:74] worker 0 stopped. I0331 03:56:33.487963 1 tasks_processing.go:74] worker 2 stopped. I0331 03:56:33.487977 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 232.361µs to process 0 records I0331 03:56:33.487992 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0331 03:56:33.488010 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0331 03:56:33.512233 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=d9e56bd1a6ceb874371c4b54aba8de5319cfceadce4e59a82287269376695187 I0331 03:56:33.512351 1 diskrecorder.go:70] Writing 109 records to /var/lib/insights-operator/insights-2026-03-31-035633.tar.gz I0331 03:56:33.519371 1 diskrecorder.go:51] Wrote 109 records to disk in 7ms I0331 03:56:33.519400 1 periodic.go:285] Gathering cluster info every 2h0m0s I0331 03:56:33.519415 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0331 03:57:41.170144 1 diskrecorder.go:223] Found files to send: insights-2026-03-31-035633.tar.gz I0331 03:57:41.170173 1 insightsuploader.go:150] Checking archives to upload periodically every 16m24.846547141s I0331 03:57:41.170182 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0331 03:57:41.182713 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0331 03:57:41.390886 1 requests.go:87] Successfully reported id=2026-03-31T03:57:41Z x-rh-insights-request-id=2abcb70dd054461f8514b972a86de54a, wrote=50782 I0331 03:57:41.390991 1 insightsuploader.go:187] Uploaded report successfully in 220.802241ms I0331 03:57:41.391015 1 controller.go:129] Initializing last reported time to 2026-03-31T03:57:41Z I0331 03:57:41.391085 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0331 03:57:41.391093 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0331 03:57:41.391100 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0331 03:57:41.396092 1 controller.go:554] The operator is healthy I0331 03:58:11.196488 1 controller.go:554] The operator is healthy I0331 03:58:42.347861 1 insightsreport.go:137] Pulling report from smart-proxy I0331 03:58:42.347884 1 insightsreport.go:149] Retrieving report I0331 03:58:42.354271 1 requests.go:110] Retrieving report for cluster: a901795c-55a8-49d9-b0a7-b2447665134d I0331 03:58:42.354282 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/a901795c-55a8-49d9-b0a7-b2447665134d/reports I0331 03:58:42.357448 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/a901795c-55a8-49d9-b0a7-b2447665134d/reports I0331 03:58:43.446819 1 insightsreport.go:184] Report retrieved I0331 03:58:43.472314 1 insightsreport.go:239] Report retrieved correctly I0331 04:00:11.197050 1 controller.go:554] The operator is healthy I0331 04:01:11.162499 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:01:11.169656 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:01:11.169675 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:01:11.176274 1 secretconfigobserver.go:119] support secret does not exist I0331 04:02:11.194668 1 controller.go:554] The operator is healthy I0331 04:04:11.199334 1 controller.go:554] The operator is healthy I0331 04:06:11.157892 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:06:11.162088 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:06:11.177165 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:06:11.181236 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:06:11.181254 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:06:11.184894 1 secretconfigobserver.go:119] support secret does not exist I0331 04:06:11.193529 1 controller.go:554] The operator is healthy I0331 04:08:11.197137 1 controller.go:554] The operator is healthy I0331 04:10:11.196855 1 controller.go:554] The operator is healthy I0331 04:11:11.185721 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:11:11.192838 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:11:11.192857 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:11:11.196894 1 secretconfigobserver.go:119] support secret does not exist I0331 04:12:11.196680 1 controller.go:554] The operator is healthy I0331 04:14:11.196123 1 controller.go:554] The operator is healthy I0331 04:14:11.239138 1 insightsuploader.go:146] Nothing to report since 2026-03-31T03:57:41Z I0331 04:16:11.159169 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:16:11.163757 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:16:11.194886 1 controller.go:554] The operator is healthy I0331 04:16:11.197668 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:16:11.202020 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:16:11.202042 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:16:11.206383 1 secretconfigobserver.go:119] support secret does not exist I0331 04:18:11.196254 1 controller.go:554] The operator is healthy I0331 04:20:11.194512 1 controller.go:554] The operator is healthy