I0330 15:01:03.102272 1 cmd.go:253] Using service-serving-cert provided certificates I0330 15:01:03.102722 1 observer_polling.go:159] Starting file observer I0330 15:01:03.673666 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0330 15:01:03.673862 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0330 15:01:03.674426 1 secure_serving.go:57] Forcing use of http/1.1 only W0330 15:01:03.674445 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0330 15:01:03.674449 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0330 15:01:03.674455 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0330 15:01:03.674459 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0330 15:01:03.674462 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0330 15:01:03.674464 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0330 15:01:03.674521 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0330 15:01:03.678382 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0330 15:01:03.678438 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"573319cb-806e-4a27-91c2-172c8dfb0cab", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0330 15:01:03.680249 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0330 15:01:03.680267 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0330 15:01:03.680292 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0330 15:01:03.680295 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0330 15:01:03.680313 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0330 15:01:03.680316 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0330 15:01:03.680625 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0330 15:01:03.680940 1 secure_serving.go:213] Serving securely on [::]:8443 I0330 15:01:03.680971 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0330 15:01:03.683633 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0330 15:01:03.683655 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0330 15:01:03.683743 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0330 15:01:03.688974 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0330 15:01:03.688997 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0330 15:01:03.693603 1 secretconfigobserver.go:119] support secret does not exist I0330 15:01:03.697442 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0330 15:01:03.700779 1 secretconfigobserver.go:119] support secret does not exist I0330 15:01:03.703297 1 recorder.go:176] Pruning old reports every 8h16m1s, max age is 288h0m0s I0330 15:01:03.711723 1 periodic.go:216] Running clusterconfig gatherer I0330 15:01:03.711743 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0330 15:01:03.711759 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0330 15:01:03.711776 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0330 15:01:03.711782 1 insightsreport.go:296] Starting report retriever I0330 15:01:03.711763 1 tasks_processing.go:45] number of workers: 64 I0330 15:01:03.711786 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0330 15:01:03.711799 1 tasks_processing.go:69] worker 0 listening for tasks. I0330 15:01:03.711806 1 tasks_processing.go:69] worker 6 listening for tasks. I0330 15:01:03.711811 1 tasks_processing.go:69] worker 2 listening for tasks. I0330 15:01:03.711817 1 tasks_processing.go:69] worker 5 listening for tasks. I0330 15:01:03.711812 1 tasks_processing.go:69] worker 1 listening for tasks. I0330 15:01:03.711822 1 tasks_processing.go:69] worker 3 listening for tasks. I0330 15:01:03.711821 1 tasks_processing.go:69] worker 4 listening for tasks. I0330 15:01:03.711828 1 tasks_processing.go:69] worker 23 listening for tasks. I0330 15:01:03.711829 1 tasks_processing.go:69] worker 18 listening for tasks. I0330 15:01:03.711833 1 tasks_processing.go:69] worker 15 listening for tasks. I0330 15:01:03.711835 1 tasks_processing.go:69] worker 28 listening for tasks. I0330 15:01:03.711831 1 tasks_processing.go:69] worker 14 listening for tasks. I0330 15:01:03.711841 1 tasks_processing.go:69] worker 19 listening for tasks. I0330 15:01:03.711840 1 tasks_processing.go:69] worker 7 listening for tasks. I0330 15:01:03.711842 1 tasks_processing.go:69] worker 16 listening for tasks. I0330 15:01:03.711846 1 tasks_processing.go:69] worker 17 listening for tasks. I0330 15:01:03.711847 1 tasks_processing.go:71] worker 28 working on aggregated_monitoring_cr_names task. I0330 15:01:03.711844 1 tasks_processing.go:71] worker 14 working on config_maps task. I0330 15:01:03.711857 1 tasks_processing.go:69] worker 9 listening for tasks. I0330 15:01:03.711860 1 tasks_processing.go:71] worker 17 working on silenced_alerts task. I0330 15:01:03.711853 1 tasks_processing.go:69] worker 33 listening for tasks. I0330 15:01:03.711866 1 tasks_processing.go:69] worker 24 listening for tasks. I0330 15:01:03.711870 1 tasks_processing.go:71] worker 19 working on oauths task. I0330 15:01:03.711871 1 tasks_processing.go:69] worker 30 listening for tasks. I0330 15:01:03.711879 1 tasks_processing.go:69] worker 32 listening for tasks. I0330 15:01:03.711882 1 tasks_processing.go:69] worker 11 listening for tasks. I0330 15:01:03.711887 1 tasks_processing.go:71] worker 32 working on infrastructures task. I0330 15:01:03.711889 1 tasks_processing.go:71] worker 11 working on nodenetworkconfigurationpolicies task. I0330 15:01:03.711894 1 tasks_processing.go:69] worker 53 listening for tasks. I0330 15:01:03.711892 1 tasks_processing.go:69] worker 21 listening for tasks. I0330 15:01:03.711904 1 tasks_processing.go:69] worker 29 listening for tasks. I0330 15:01:03.711906 1 tasks_processing.go:69] worker 34 listening for tasks. I0330 15:01:03.711912 1 tasks_processing.go:69] worker 20 listening for tasks. I0330 15:01:03.711857 1 tasks_processing.go:69] worker 26 listening for tasks. I0330 15:01:03.711914 1 tasks_processing.go:69] worker 35 listening for tasks. I0330 15:01:03.711914 1 tasks_processing.go:69] worker 63 listening for tasks. I0330 15:01:03.711865 1 tasks_processing.go:71] worker 9 working on support_secret task. I0330 15:01:03.711932 1 tasks_processing.go:69] worker 36 listening for tasks. I0330 15:01:03.711933 1 tasks_processing.go:69] worker 45 listening for tasks. I0330 15:01:03.711928 1 tasks_processing.go:69] worker 12 listening for tasks. I0330 15:01:03.711865 1 tasks_processing.go:69] worker 27 listening for tasks. I0330 15:01:03.711948 1 tasks_processing.go:69] worker 56 listening for tasks. I0330 15:01:03.711850 1 tasks_processing.go:71] worker 7 working on node_features task. I0330 15:01:03.711952 1 tasks_processing.go:69] worker 49 listening for tasks. I0330 15:01:03.711960 1 tasks_processing.go:69] worker 48 listening for tasks. I0330 15:01:03.711962 1 tasks_processing.go:69] worker 52 listening for tasks. I0330 15:01:03.711964 1 tasks_processing.go:69] worker 43 listening for tasks. I0330 15:01:03.711968 1 tasks_processing.go:71] worker 26 working on cost_management_metrics_configs task. I0330 15:01:03.711970 1 tasks_processing.go:69] worker 46 listening for tasks. I0330 15:01:03.711974 1 tasks_processing.go:71] worker 1 working on nodenetworkstates task. I0330 15:01:03.711976 1 tasks_processing.go:71] worker 15 working on sap_config task. I0330 15:01:03.711977 1 tasks_processing.go:71] worker 43 working on machine_healthchecks task. I0330 15:01:03.711980 1 tasks_processing.go:71] worker 53 working on image_pruners task. I0330 15:01:03.711985 1 tasks_processing.go:71] worker 27 working on tsdb_status task. I0330 15:01:03.711988 1 tasks_processing.go:71] worker 20 working on networks task. I0330 15:01:03.711986 1 tasks_processing.go:71] worker 63 working on image_registries task. I0330 15:01:03.712337 1 tasks_processing.go:71] worker 21 working on machines task. I0330 15:01:03.711983 1 tasks_processing.go:71] worker 34 working on proxies task. I0330 15:01:03.711882 1 tasks_processing.go:71] worker 30 working on container_runtime_configs task. I0330 15:01:03.711975 1 tasks_processing.go:71] worker 29 working on openshift_logging task. I0330 15:01:03.711980 1 tasks_processing.go:71] worker 12 working on openstack_dataplanedeployments task. I0330 15:01:03.711970 1 tasks_processing.go:71] worker 5 working on version task. I0330 15:01:03.711849 1 tasks_processing.go:69] worker 8 listening for tasks. I0330 15:01:03.711874 1 tasks_processing.go:71] worker 33 working on container_images task. I0330 15:01:03.712184 1 tasks_processing.go:69] worker 22 listening for tasks. I0330 15:01:03.712766 1 tasks_processing.go:69] worker 40 listening for tasks. I0330 15:01:03.712772 1 tasks_processing.go:71] worker 8 working on ceph_cluster task. I0330 15:01:03.711882 1 tasks_processing.go:71] worker 24 working on pdbs task. I0330 15:01:03.712844 1 tasks_processing.go:71] worker 22 working on machine_configs task. I0330 15:01:03.711888 1 tasks_processing.go:69] worker 31 listening for tasks. I0330 15:01:03.712909 1 tasks_processing.go:71] worker 31 working on ingress task. I0330 15:01:03.712911 1 tasks_processing.go:69] worker 62 listening for tasks. I0330 15:01:03.711920 1 tasks_processing.go:69] worker 13 listening for tasks. I0330 15:01:03.712818 1 tasks_processing.go:71] worker 40 working on monitoring_persistent_volumes task. I0330 15:01:03.712929 1 tasks_processing.go:71] worker 13 working on openstack_controlplanes task. I0330 15:01:03.712940 1 tasks_processing.go:71] worker 62 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0330 15:01:03.711923 1 tasks_processing.go:69] worker 44 listening for tasks. I0330 15:01:03.711927 1 tasks_processing.go:69] worker 58 listening for tasks. I0330 15:01:03.713061 1 tasks_processing.go:71] worker 58 working on openstack_version task. I0330 15:01:03.711936 1 tasks_processing.go:69] worker 54 listening for tasks. I0330 15:01:03.711943 1 tasks_processing.go:69] worker 55 listening for tasks. I0330 15:01:03.711944 1 tasks_processing.go:69] worker 50 listening for tasks. I0330 15:01:03.711947 1 tasks_processing.go:69] worker 41 listening for tasks. I0330 15:01:03.711873 1 tasks_processing.go:69] worker 10 listening for tasks. I0330 15:01:03.711953 1 tasks_processing.go:69] worker 51 listening for tasks. I0330 15:01:03.711956 1 tasks_processing.go:71] worker 0 working on openshift_machine_api_events task. I0330 15:01:03.711956 1 tasks_processing.go:69] worker 42 listening for tasks. I0330 15:01:03.711957 1 tasks_processing.go:71] worker 3 working on image task. I0330 15:01:03.713136 1 tasks_processing.go:71] worker 42 working on active_alerts task. I0330 15:01:03.713136 1 tasks_processing.go:71] worker 55 working on machine_autoscalers task. I0330 15:01:03.713143 1 tasks_processing.go:71] worker 50 working on sap_pods task. I0330 15:01:03.711960 1 tasks_processing.go:71] worker 4 working on operators_pods_and_events task. I0330 15:01:03.713179 1 tasks_processing.go:71] worker 10 working on ingress_certificates task. I0330 15:01:03.711857 1 tasks_processing.go:71] worker 16 working on nodes task. I0330 15:01:03.713138 1 tasks_processing.go:71] worker 41 working on validating_webhook_configurations task. I0330 15:01:03.713224 1 tasks_processing.go:71] worker 51 working on pod_network_connectivity_checks task. I0330 15:01:03.711961 1 tasks_processing.go:71] worker 6 working on install_plans task. I0330 15:01:03.713241 1 tasks_processing.go:71] worker 54 working on machine_sets task. I0330 15:01:03.711966 1 tasks_processing.go:71] worker 2 working on storage_cluster task. I0330 15:01:03.711965 1 tasks_processing.go:71] worker 23 working on cluster_apiserver task. I0330 15:01:03.711968 1 tasks_processing.go:71] worker 49 working on clusterroles task. I0330 15:01:03.711969 1 tasks_processing.go:71] worker 48 working on overlapping_namespace_uids task. I0330 15:01:03.711972 1 tasks_processing.go:71] worker 18 working on jaegers task. I0330 15:01:03.711970 1 tasks_processing.go:69] worker 57 listening for tasks. I0330 15:01:03.714040 1 tasks_processing.go:71] worker 57 working on node_logs task. I0330 15:01:03.711973 1 tasks_processing.go:71] worker 35 working on feature_gates task. I0330 15:01:03.711858 1 tasks_processing.go:69] worker 25 listening for tasks. I0330 15:01:03.714668 1 tasks_processing.go:71] worker 25 working on service_accounts task. I0330 15:01:03.711978 1 tasks_processing.go:69] worker 60 listening for tasks. I0330 15:01:03.711979 1 tasks_processing.go:71] worker 46 working on lokistack task. I0330 15:01:03.711980 1 tasks_processing.go:71] worker 45 working on machine_config_pools task. I0330 15:01:03.711987 1 tasks_processing.go:69] worker 59 listening for tasks. I0330 15:01:03.711991 1 tasks_processing.go:69] worker 61 listening for tasks. I0330 15:01:03.711989 1 tasks_processing.go:71] worker 52 working on sap_datahubs task. I0330 15:01:03.711991 1 tasks_processing.go:69] worker 38 listening for tasks. I0330 15:01:03.711990 1 tasks_processing.go:69] worker 39 listening for tasks. I0330 15:01:03.712004 1 tasks_processing.go:69] worker 37 listening for tasks. I0330 15:01:03.712661 1 tasks_processing.go:71] worker 56 working on crds task. I0330 15:01:03.711989 1 tasks_processing.go:71] worker 36 working on qemu_kubevirt_launcher_logs task. I0330 15:01:03.713052 1 tasks_processing.go:71] worker 44 working on dvo_metrics task. I0330 15:01:03.711961 1 tasks_processing.go:69] worker 47 listening for tasks. I0330 15:01:03.715800 1 tasks_processing.go:71] worker 47 working on storage_classes task. I0330 15:01:03.715908 1 tasks_processing.go:71] worker 60 working on mutating_webhook_configurations task. I0330 15:01:03.715959 1 tasks_processing.go:71] worker 59 working on authentication task. I0330 15:01:03.716026 1 tasks_processing.go:71] worker 61 working on openstack_dataplanenodesets task. I0330 15:01:03.716155 1 tasks_processing.go:71] worker 38 working on certificate_signing_requests task. I0330 15:01:03.716288 1 tasks_processing.go:71] worker 39 working on olm_operators task. I0330 15:01:03.716350 1 tasks_processing.go:71] worker 37 working on metrics task. I0330 15:01:03.716502 1 tasks_processing.go:71] worker 2 working on operators task. I0330 15:01:03.716504 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 3.221149ms to process 0 records I0330 15:01:03.717982 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0330 15:01:03.718007 1 controller.go:368] The initial operator extension status is healthy I0330 15:01:03.718022 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0330 15:01:03.718028 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0330 15:01:03.718030 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0330 15:01:03.718044 1 controller.go:531] The operator is still being initialized I0330 15:01:03.718050 1 controller.go:554] The operator is healthy I0330 15:01:03.718166 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0330 15:01:03.718238 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0330 15:01:03.718316 1 operator.go:328] started I0330 15:01:03.718351 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0330 15:01:03.718600 1 tasks_processing.go:71] worker 11 working on schedulers task. I0330 15:01:03.718618 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 6.701788ms to process 0 records I0330 15:01:03.718912 1 tasks_processing.go:74] worker 23 stopped. I0330 15:01:03.719155 1 recorder.go:75] Recording config/apiserver with fingerprint=92874b17a5dec0e7e4624c9884fc2bbd88670cecab78271bcd50fb09a224b7d6 I0330 15:01:03.719169 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 5.591481ms to process 1 records E0330 15:01:03.720561 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.230.236:9091: connect: connection refused I0330 15:01:03.720580 1 tasks_processing.go:74] worker 37 stopped. E0330 15:01:03.720587 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.230.236:9091: connect: connection refused I0330 15:01:03.720599 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 4.219486ms to process 0 records E0330 15:01:03.720611 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.230.236:9091: connect: connection refused I0330 15:01:03.720636 1 tasks_processing.go:74] worker 27 stopped. E0330 15:01:03.720648 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.230.236:9091: connect: connection refused I0330 15:01:03.720667 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 8.636527ms to process 0 records I0330 15:01:03.724260 1 tasks_processing.go:74] worker 30 stopped. I0330 15:01:03.724272 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 11.810391ms to process 0 records I0330 15:01:03.724286 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 12.283101ms to process 0 records I0330 15:01:03.724291 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 8.230217ms to process 0 records I0330 15:01:03.724295 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 10.482399ms to process 0 records I0330 15:01:03.724298 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 11.503386ms to process 0 records I0330 15:01:03.724305 1 tasks_processing.go:74] worker 8 stopped. I0330 15:01:03.724310 1 tasks_processing.go:74] worker 26 stopped. I0330 15:01:03.724314 1 tasks_processing.go:74] worker 61 stopped. I0330 15:01:03.724317 1 tasks_processing.go:74] worker 18 stopped. I0330 15:01:03.724381 1 tasks_processing.go:74] worker 45 stopped. I0330 15:01:03.724399 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 9.330701ms to process 0 records I0330 15:01:03.724500 1 tasks_processing.go:74] worker 34 stopped. I0330 15:01:03.724558 1 recorder.go:75] Recording config/proxy with fingerprint=2c7016ec73e4f2270058743647adcf807cd9068be46dbb0f906eec2b69610b7b I0330 15:01:03.724573 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 12.073688ms to process 1 records I0330 15:01:03.724656 1 tasks_processing.go:74] worker 19 stopped. I0330 15:01:03.724762 1 recorder.go:75] Recording config/oauth with fingerprint=d580a3140f86a9c23b00a2751bc030fd0cfc7859ff13e22417b9378329959dc7 I0330 15:01:03.724771 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 12.656333ms to process 1 records I0330 15:01:03.730095 1 tasks_processing.go:74] worker 29 stopped. I0330 15:01:03.730109 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 17.589197ms to process 0 records I0330 15:01:03.730119 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 15.238422ms to process 0 records I0330 15:01:03.730123 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 18.119778ms to process 0 records I0330 15:01:03.730127 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 18.123182ms to process 0 records I0330 15:01:03.730132 1 tasks_processing.go:74] worker 15 stopped. I0330 15:01:03.730136 1 tasks_processing.go:74] worker 1 stopped. I0330 15:01:03.730141 1 tasks_processing.go:74] worker 46 stopped. I0330 15:01:03.730180 1 tasks_processing.go:74] worker 43 stopped. E0330 15:01:03.730191 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0330 15:01:03.730198 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 18.192441ms to process 0 records I0330 15:01:03.730210 1 tasks_processing.go:74] worker 9 stopped. E0330 15:01:03.730221 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0330 15:01:03.730230 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 18.271912ms to process 0 records I0330 15:01:03.730282 1 tasks_processing.go:74] worker 21 stopped. E0330 15:01:03.730293 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0330 15:01:03.730301 1 gather.go:177] gatherer "clusterconfig" function "machines" took 17.931901ms to process 0 records I0330 15:01:03.730403 1 tasks_processing.go:74] worker 50 stopped. I0330 15:01:03.730414 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 17.25309ms to process 0 records I0330 15:01:03.730453 1 tasks_processing.go:74] worker 40 stopped. I0330 15:01:03.730460 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 17.522524ms to process 0 records I0330 15:01:03.730533 1 tasks_processing.go:74] worker 20 stopped. I0330 15:01:03.730680 1 recorder.go:75] Recording config/network with fingerprint=7857184eb33af40d52ceeebdca23fb45862d0895862b37f01525f917b6f855aa I0330 15:01:03.730698 1 gather.go:177] gatherer "clusterconfig" function "networks" took 18.537568ms to process 1 records I0330 15:01:03.730716 1 tasks_processing.go:74] worker 32 stopped. I0330 15:01:03.732233 1 recorder.go:75] Recording config/infrastructure with fingerprint=72961fdcb73ef544d73b7d39235053c6d3933069894767944b8933b1f7b08082 I0330 15:01:03.732349 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 18.820975ms to process 1 records I0330 15:01:03.732392 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 15.803676ms to process 0 records I0330 15:01:03.732452 1 tasks_processing.go:74] worker 52 stopped. I0330 15:01:03.732521 1 tasks_processing.go:74] worker 53 stopped. I0330 15:01:03.733188 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=11aeb0809b08a1fd8dce45eed9437c6929f0850bca2ec1eb5142ccf7da7029aa I0330 15:01:03.733209 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 20.107528ms to process 1 records I0330 15:01:03.733219 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 18.695597ms to process 0 records I0330 15:01:03.733224 1 tasks_processing.go:74] worker 57 stopped. I0330 15:01:03.734268 1 tasks_processing.go:74] worker 12 stopped. I0330 15:01:03.734293 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 21.666882ms to process 0 records E0330 15:01:03.734316 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0330 15:01:03.734344 1 tasks_processing.go:74] worker 7 stopped. I0330 15:01:03.734352 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 22.362367ms to process 0 records I0330 15:01:03.734424 1 tasks_processing.go:74] worker 55 stopped. I0330 15:01:03.734440 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 21.276503ms to process 0 records I0330 15:01:03.734453 1 gather_logs.go:145] no pods in namespace were found I0330 15:01:03.734454 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 21.513144ms to process 0 records I0330 15:01:03.734463 1 tasks_processing.go:74] worker 13 stopped. I0330 15:01:03.734466 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 21.351967ms to process 0 records I0330 15:01:03.734473 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 18.975184ms to process 0 records I0330 15:01:03.734477 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 21.229468ms to process 0 records I0330 15:01:03.734482 1 tasks_processing.go:74] worker 54 stopped. I0330 15:01:03.734486 1 tasks_processing.go:74] worker 0 stopped. I0330 15:01:03.734489 1 tasks_processing.go:74] worker 36 stopped. I0330 15:01:03.734581 1 tasks_processing.go:74] worker 47 stopped. I0330 15:01:03.734693 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=5ac8646173c232be9bded6f451b882902286881d85db129b5884513c0469e4b9 I0330 15:01:03.734716 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=c8081c0de64a42ee00eff48f9e740d932dcd8df1d825822cc432db93c17ac426 I0330 15:01:03.734729 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 18.764517ms to process 2 records I0330 15:01:03.734823 1 tasks_processing.go:74] worker 35 stopped. I0330 15:01:03.734868 1 recorder.go:75] Recording config/featuregate with fingerprint=bbb7ef6aa99486ea798d0077d4680916b3705717c9467501d453dcaba1accf33 I0330 15:01:03.734885 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 20.474091ms to process 1 records I0330 15:01:03.734906 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0330 15:01:03.734918 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 21.171244ms to process 1 records I0330 15:01:03.734969 1 tasks_processing.go:74] worker 48 stopped. I0330 15:01:03.735039 1 tasks_processing.go:74] worker 59 stopped. I0330 15:01:03.735072 1 recorder.go:75] Recording config/authentication with fingerprint=dbbf545fe7b2e735b6f3a05d215fe5c7acd07506b2d56cb4421952dbf5a0e297 I0330 15:01:03.735085 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 18.931774ms to process 1 records I0330 15:01:03.735174 1 tasks_processing.go:74] worker 63 stopped. I0330 15:01:03.735489 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=d6dcbbccfc5312c035a75cb5c5dc55b9c923fd17b25582fb4927a22c2976e9dd I0330 15:01:03.735503 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 22.928212ms to process 1 records I0330 15:01:03.738154 1 tasks_processing.go:74] worker 51 stopped. E0330 15:01:03.738165 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0330 15:01:03.738174 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 24.913736ms to process 0 records I0330 15:01:03.738179 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 25.094877ms to process 0 records I0330 15:01:03.738184 1 tasks_processing.go:74] worker 58 stopped. I0330 15:01:03.744387 1 tasks_processing.go:74] worker 11 stopped. I0330 15:01:03.744477 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=f1028e5613c1d6660026469caabd700d998f5720b358551539081a0398afe473 I0330 15:01:03.744492 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 25.773828ms to process 1 records I0330 15:01:03.744512 1 tasks_processing.go:74] worker 24 stopped. I0330 15:01:03.744614 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=de1d9e60a7c9c98dbc43002219809d7c8930c5f101c6f4cb7d3271e8a94f14cd I0330 15:01:03.744639 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=1ef7c6d4ed258d659334783b691a5bcf6c753279d25569546d6c38828140f3e7 I0330 15:01:03.744667 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=27dfc0fe8dda283f83ee73c0ba16d66ea197e79061ddb974a1f3786d47b45402 I0330 15:01:03.744714 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=b908393803ae51115ca1deddc90784aaaa831d233c844fa534ab132865a2c084 I0330 15:01:03.744733 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=a1f78a47543130acd1feeaec57ad818e894453f0c43c13c3d0f45a6b7080a95c I0330 15:01:03.744746 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=635fe12c8a2e3a119326ac1aa0421af4cfd4de4ad984c9782e2be314086db528 I0330 15:01:03.744759 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=f6b2698f6434908922d0248fd8ac82e2c13ffce9f2b0b853ec692419eb31f986 I0330 15:01:03.744776 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=968a9f2d252f6a93509526ac00f2bdb3c8bc950b50002e16577a3e4e483dbfa3 I0330 15:01:03.744788 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=fc5e193fd29ef7e5d7cf8b37e731247ae9d322761bfe75c00ebf363278b8843d I0330 15:01:03.744814 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=3983cb164fec659fd1aeda94d6f64d1915997c54337bb7da31346211aa87f8bb I0330 15:01:03.744840 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=f9b7e3ee2b143984eb5e89af54b4882d8928f21272ba415fdfe478f00830f5c1 I0330 15:01:03.744851 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 31.682276ms to process 11 records I0330 15:01:03.744940 1 tasks_processing.go:74] worker 3 stopped. I0330 15:01:03.744964 1 recorder.go:75] Recording config/image with fingerprint=3b856d3a651a901eda82632e24d9b8a178ab61da8a0087d3af832e4879b89ff2 I0330 15:01:03.744974 1 gather.go:177] gatherer "clusterconfig" function "image" took 31.528619ms to process 1 records I0330 15:01:03.745304 1 tasks_processing.go:74] worker 31 stopped. I0330 15:01:03.745461 1 recorder.go:75] Recording config/ingress with fingerprint=4637129e54c462e661b176a2acbfaeb74d5ef10173a24be7da87f92dd16fa134 I0330 15:01:03.745478 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 32.383305ms to process 1 records I0330 15:01:03.745653 1 tasks_processing.go:74] worker 22 stopped. E0330 15:01:03.745668 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0330 15:01:03.745692 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0330 15:01:03.745709 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 32.795634ms to process 1 records I0330 15:01:03.746610 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0330 15:01:03.747061 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0330 15:01:03.747119 1 controller.go:254] Source scaController *sca.Controller is not ready I0330 15:01:03.747153 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0330 15:01:03.747178 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0330 15:01:03.747247 1 controller.go:531] The operator is still being initialized I0330 15:01:03.747274 1 controller.go:554] The operator is healthy I0330 15:01:03.746863 1 tasks_processing.go:74] worker 16 stopped. W0330 15:01:03.747595 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0330 15:01:03.747734 1 recorder.go:75] Recording config/node/ip-10-0-0-65.ec2.internal with fingerprint=0f16f7887d680ceff46867fe74219194d0b9f62e48f5c2598ee3a98e7268e7e3 I0330 15:01:03.748014 1 recorder.go:75] Recording config/node/ip-10-0-1-27.ec2.internal with fingerprint=8b9c842d26d216c03af3fdd36a9f9829659eb642efa1d3df7f6343466cdf0a30 I0330 15:01:03.748937 1 recorder.go:75] Recording config/node/ip-10-0-2-167.ec2.internal with fingerprint=16d9492764104fb4c482e852b7cbe380aecc9eec53bdc38101cddb9ea6269553 I0330 15:01:03.748963 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 33.658808ms to process 3 records I0330 15:01:03.749426 1 tasks_processing.go:74] worker 39 stopped. I0330 15:01:03.749447 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 33.119986ms to process 0 records I0330 15:01:03.749910 1 tasks_processing.go:74] worker 60 stopped. I0330 15:01:03.750080 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=e8a44dde64f6e4b1bbdfce71015288627cd685b6bb632ad8263f93ef7d69857a I0330 15:01:03.750133 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=c521957fb3443c5c9f5ee6b1a66842e19fc113a22ec28a629b7ab95ee006adcc I0330 15:01:03.750179 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=a2fc019607a7a5565387e8254339676f969a59ecadd51d3909fa3b8c933292fe I0330 15:01:03.750191 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.986349ms to process 3 records I0330 15:01:03.750564 1 tasks_processing.go:74] worker 56 stopped. I0330 15:01:03.751055 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=a8287871a9cc57f70e7077066393511f715ac7853de15d40f0f2306b36dcb2c4 I0330 15:01:03.751272 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=e9ae16ff45a62e696520f7697f1f0c27fb4c0610a7874b43ca86ec38e3a21cea I0330 15:01:03.751282 1 gather.go:177] gatherer "clusterconfig" function "crds" took 35.492972ms to process 2 records I0330 15:01:03.751369 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=aecac9842022772dcd63b9a83c62a8618e7f37010007c1d2a17812a90ee29faf I0330 15:01:03.751407 1 tasks_processing.go:74] worker 41 stopped. I0330 15:01:03.751434 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=3b25b9485782cf410689e2964335f09d41dfd2b59c1c49d0c726eaa97377cb71 I0330 15:01:03.751501 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=5123e5e3f4a93d9e286d528257bb6dc087039f2fa582ccbf2a28f69708235f9a I0330 15:01:03.751525 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=398fa42504adb86829d0aa94e6a7eb57e43b139eef78c9566e5780c4524b3d66 I0330 15:01:03.751551 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=56288c486994312537c25d6ebfa04c9ecb59b8abd4873da111a5cdb545260f97 I0330 15:01:03.751580 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=9f05abc0e57404d189e6147712e07899ad3d389291af9f8108474b45053f4472 I0330 15:01:03.751655 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=7757ac32f992c6b9e04e398ebe8144b7cd7adb33911d81cd8f75e92786eae884 I0330 15:01:03.751701 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=2225421f845cd0937150a34d100f9ee4b5ed776edd44f31854ee5cb72f6c5b29 I0330 15:01:03.751746 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=db15667bfc9c1946a906f9a16eacec7af747d45054644d772929e30cc7628e88 I0330 15:01:03.751825 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=77dae220d56dac149a886c32396e6bd83f9d69a8d6ca957b45c71b34c4e42c7b I0330 15:01:03.751904 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=743618f7f7742d4ba119b001af6f8858a867614527ef2aaee07857daf2c4f84e I0330 15:01:03.751970 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=60a86aa241e794b3d1db6516ae9b53d034982755bb7686ca886251f87540756d I0330 15:01:03.752033 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=7f4a7a3a3f4b3d3cfb11fd8532fb9f39190b6114f5b573dfcea711f082f9c192 I0330 15:01:03.752058 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 37.679695ms to process 13 records I0330 15:01:03.752608 1 tasks_processing.go:74] worker 5 stopped. I0330 15:01:03.753116 1 recorder.go:75] Recording config/version with fingerprint=66499d4d09027d1941333b37955632970bf778c8a7196d626cef7628a52c7877 I0330 15:01:03.753211 1 recorder.go:75] Recording config/id with fingerprint=3c69bae49e4bad8acc2715872be1ce4ae7bfe0bcecc524517df2d3ca29d22ee8 I0330 15:01:03.753228 1 gather.go:177] gatherer "clusterconfig" function "version" took 38.559408ms to process 2 records I0330 15:01:03.753563 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=a30f2b835df40f62e4d5936e2f879826205e38a48eafd55cdd53716b148ff1c7 I0330 15:01:03.753677 1 tasks_processing.go:74] worker 49 stopped. I0330 15:01:03.753719 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=0070ea63c3d769e4ff4af6b5d6989460db5df96d985b1091420ad784b0f00598 I0330 15:01:03.753751 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 37.747908ms to process 2 records I0330 15:01:03.753765 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 40.146835ms to process 0 records I0330 15:01:03.753779 1 tasks_processing.go:74] worker 28 stopped. I0330 15:01:03.756287 1 tasks_processing.go:74] worker 38 stopped. I0330 15:01:03.756306 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 40.111878ms to process 0 records I0330 15:01:03.764604 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0330 15:01:03.769569 1 tasks_processing.go:74] worker 10 stopped. E0330 15:01:03.769585 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0330 15:01:03.769592 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pc3srqfa75va1b7r65hvfp4e15g46er-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pc3srqfa75va1b7r65hvfp4e15g46er-primary-cert-bundle-secret" not found I0330 15:01:03.769641 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=4116c4b457b4b1eab45d4688e4c5e8d42cce4f856339cfa7f84c48eb67898404 I0330 15:01:03.769654 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 56.371268ms to process 1 records I0330 15:01:03.771169 1 tasks_processing.go:74] worker 14 stopped. E0330 15:01:03.771182 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0330 15:01:03.771189 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0330 15:01:03.771203 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0330 15:01:03.771212 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=7c953bef0cdbddb25a47a3c40772dfa7cbf73ae2ac9bb3dc97984dbf1bd43499 I0330 15:01:03.771245 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0330 15:01:03.771252 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0330 15:01:03.771256 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=4bec6f0bfa45f0ccf5709371166150dcb9cf2703d04f5f6de4476d0277c477a6 I0330 15:01:03.771279 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0330 15:01:03.771319 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0330 15:01:03.771342 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0330 15:01:03.771348 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 59.300717ms to process 7 records I0330 15:01:03.772375 1 tasks_processing.go:74] worker 33 stopped. I0330 15:01:03.775060 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-8777bd9bb-87zv5 with fingerprint=203bad2345c964330ebc9001dfb198128cf5a61a05645f8ad1533f3f411dc558 I0330 15:01:03.775314 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-5mknx with fingerprint=c0f06f186cd9ed691ee71f6c9dc245739701693fd58ccd79f80fd7d04eeb47f0 I0330 15:01:03.775406 1 recorder.go:75] Recording config/running_containers with fingerprint=53875ac246d51ad0524ff6039e242298ddaf418ffbacdc2ce54af872d959d7fc I0330 15:01:03.775417 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 59.640753ms to process 3 records I0330 15:01:03.775424 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 61.05645ms to process 0 records I0330 15:01:03.775430 1 tasks_processing.go:74] worker 62 stopped. I0330 15:01:03.780587 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0330 15:01:03.780597 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0330 15:01:03.780619 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0330 15:01:03.784622 1 base_controller.go:82] Caches are synced for ConfigController I0330 15:01:03.784633 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0330 15:01:03.788146 1 configmapobserver.go:84] configmaps "insights-config" not found I0330 15:01:03.818746 1 base_controller.go:82] Caches are synced for LoggingSyncer I0330 15:01:03.818758 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0330 15:01:03.822267 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2m285 pod in namespace openshift-ingress-canary (previous: false). I0330 15:01:03.830991 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8p69g pod in namespace openshift-ingress-canary (previous: false). I0330 15:01:03.862130 1 cluster_transfer.go:102] no available accepted cluster transfer I0330 15:01:03.862144 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0330 15:01:03.953114 1 sca.go:266] etc-pki-entitlement secret successfully created I0330 15:01:03.953131 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0330 15:01:03.966854 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-qkcsd pod in namespace openshift-ingress-canary (previous: false). I0330 15:01:04.169019 1 tasks_processing.go:74] worker 4 stopped. I0330 15:01:04.169257 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=4e24f82697e69ff9c91ab4b290d043cf4250d59ace2794ad7dcc3191dc439053 I0330 15:01:04.169477 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=fb284cc042bfbbc3a01758e037f2788899747f3982df7cd8bb8c723ad4b976e0 I0330 15:01:04.169590 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=244dcada22e0eaa775aee041d8459fd8ec03dbdb60d43b655af737d11fb6505d I0330 15:01:04.169679 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-78459bd87c-6zkgf/router_current.log with fingerprint=82937d2b25313b5a13a956e686fa143b69b56619807911e8d9001f0531e03ff0 I0330 15:01:04.169806 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-78459bd87c-rz9gd/router_current.log with fingerprint=6b10f1b877e30d931d905136a20691ea7d484de34db12844f57b69e77b6bc61b I0330 15:01:04.169872 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-79cb556bcf-kl4ns/router_current.log with fingerprint=6caf1f51830ae2e546d2c3607adff1102cd2b0a23ea959c0799e5f39906353e5 I0330 15:01:04.169907 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-2m285/serve-healthcheck-canary_current.log with fingerprint=4a865bfd2ed871cf0963cdc1703aa5e2db27c0cd3b90a89ea3e4b7703e7f2b65 I0330 15:01:04.169931 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-8p69g/serve-healthcheck-canary_current.log with fingerprint=f66640878ff833124102626a129f51d93911d689f54b7cbc3ab7b75599682fa9 I0330 15:01:04.169955 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-qkcsd/serve-healthcheck-canary_current.log with fingerprint=039710188583bd1157400a41440e11844f0c431eafcbf89f51934a165bde408b I0330 15:01:04.169982 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 455.825025ms to process 9 records W0330 15:01:04.747003 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0330 15:01:04.790266 1 tasks_processing.go:74] worker 42 stopped. I0330 15:01:04.790321 1 recorder.go:75] Recording config/alerts with fingerprint=1529664c3c4bfb8851183db222afa8688815c4387c498b135fc226a0bc6cd9ae I0330 15:01:04.790359 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.077117582s to process 1 records I0330 15:01:04.790377 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0330 15:01:04.790387 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.078408293s to process 1 records I0330 15:01:04.790396 1 tasks_processing.go:74] worker 17 stopped. W0330 15:01:05.747276 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0330 15:01:06.179579 1 tasks_processing.go:74] worker 2 stopped. I0330 15:01:06.179693 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=6ffb8e9a13ee896a1a5e8217985d1689c766afe403d585ade2a9f3549211aa6a I0330 15:01:06.179746 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0330 15:01:06.179781 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=726b4ed6a9fc2fc3520628824351108d06f29345470bcdaa55fcbe0c03e54c8c I0330 15:01:06.179792 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0330 15:01:06.179815 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=10b91d571722039617aa7c32f9a0d4b3e615c0179fa981dec9bea6278e986b0b I0330 15:01:06.179830 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0330 15:01:06.179858 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=43987d3373b18d72fc38605e7e39daf79ff85a6aeec53d3f34d760de3a5d6da4 I0330 15:01:06.179889 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=c6d05ff61964935d22499b4f8e2fe33a79ac616085adb90e25d7367df862371f I0330 15:01:06.179915 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=8ae01ff324a8026fb09b7c95ed41e6c252926a33abb28a334e8fa2e881e0d265 I0330 15:01:06.179943 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=55d2e50b406886ac40fa36bde8b079c54c6d1fe07c46b58a6bb5f8e0de25e0d1 I0330 15:01:06.180210 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=0478472efd892e9582b2e363a31381fd7f41df8e28e5f15d2e07b55026fa9fde I0330 15:01:06.180230 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=61598ae55b507704b3c2ad64d0a039d8cced782f825d597a099c2c2617b2cd04 I0330 15:01:06.180239 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0330 15:01:06.180256 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=d63a3c4a5cd85cf5dc995b352ff83b24ca63d21338b849d46103c033c8113ef2 I0330 15:01:06.180264 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0330 15:01:06.180279 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=e5e4410ac49f194a33e43d7c9d61fcccbc20346057ec7de4ddcb3a72600c2675 I0330 15:01:06.180288 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0330 15:01:06.180308 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=d60d060f3f38fcdd4e7890e22caad1b3ac6e30584ad76e13563dac2dcc010ee0 I0330 15:01:06.180318 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0330 15:01:06.180351 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=7bab6edf963f4486a78f3fed0b76d070655cabcdc8b2077142160c7668248ba2 I0330 15:01:06.180456 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=859941098a16a27103c963dbc204fb94fa2ec7580d647a3bae916616c81e426e I0330 15:01:06.180465 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0330 15:01:06.180473 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0330 15:01:06.180495 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0330 15:01:06.180519 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=cb1ba5c4f23b647ff969852f23cb0dc1bd1e754c56a0505fb678aebfee514076 I0330 15:01:06.180543 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=bbd2a393d31c2565107a2aa16c37b3a6c01d7106031ad49762e16d39911710c5 I0330 15:01:06.180554 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0330 15:01:06.180574 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=f26d899379977da5b48f727925a5bcdb97f9563c0b05424fdf5f52106b4a54ff I0330 15:01:06.180584 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0330 15:01:06.180600 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=a3fc201485e89f325395194015cc2208b49c0f39a07dbc65cd369482f30ab157 I0330 15:01:06.180610 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0330 15:01:06.180622 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=4cbeab808901f0e5d1a58119000dc6db789405d61858d5807b086ad3d2854264 I0330 15:01:06.180636 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=72aed00a7e4e29467992fbaae51dcfd273bdead78468382c5e09774cb96a3099 I0330 15:01:06.180650 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=6c5fb3612cb8f3adf4563cba0d9405c37f0ca43ec3cbc463517f07e8a175d8da I0330 15:01:06.180670 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=f2d79c7e52caa4c700ada2e222c53ffccea7e5d45f7fdf06f05f2755a6225c42 I0330 15:01:06.180679 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0330 15:01:06.180706 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=ffc41a55699b9a50b768327d4f3167da90534b1e557b1b1e1a699f1142b20b36 I0330 15:01:06.180723 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0330 15:01:06.180731 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0330 15:01:06.180764 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.463049131s to process 39 records W0330 15:01:06.746558 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0330 15:01:07.746454 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0330 15:01:08.744826 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0330 15:01:08.744853 1 tasks_processing.go:74] worker 44 stopped. E0330 15:01:08.744869 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0330 15:01:08.744879 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0330 15:01:08.744891 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.029263482s to process 1 records I0330 15:01:16.555281 1 tasks_processing.go:74] worker 6 stopped. I0330 15:01:16.555345 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0330 15:01:16.555359 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.842027441s to process 1 records I0330 15:01:17.320659 1 tasks_processing.go:74] worker 25 stopped. I0330 15:01:17.320942 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=16e4c55b4d63cefcfc7800aa646e617d46f0ec5f940c3fd1a629fc5ae985c964 I0330 15:01:17.320960 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605972936s to process 1 records E0330 15:01:17.321029 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.609s with: function \"metrics\" failed with an error, function \"tsdb_status\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0330 15:01:17.322144 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "metrics" failed with an error, function "tsdb_status" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0330 15:01:17.322162 1 periodic.go:216] Running workloads gatherer I0330 15:01:17.322179 1 tasks_processing.go:45] number of workers: 2 I0330 15:01:17.322187 1 tasks_processing.go:69] worker 1 listening for tasks. I0330 15:01:17.322192 1 tasks_processing.go:71] worker 1 working on workload_info task. I0330 15:01:17.322261 1 tasks_processing.go:69] worker 0 listening for tasks. I0330 15:01:17.322340 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0330 15:01:17.328016 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-167.ec2.internal... I0330 15:01:17.328019 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-65.ec2.internal... I0330 15:01:17.328032 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-27.ec2.internal... I0330 15:01:17.345386 1 tasks_processing.go:74] worker 0 stopped. I0330 15:01:17.345403 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 23.022922ms to process 0 records I0330 15:01:21.823836 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 5s I0330 15:01:21.849036 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0330 15:01:21.860483 1 gather_workloads_info.go:387] No image sha256:273930332d7b481bbca4521cf740507498a2a323a4010cd66e896806b299f85e (13ms) I0330 15:01:21.869873 1 gather_workloads_info.go:387] No image sha256:0fd69333c121efd68919e731cd3ea01e976e00415bda6e987bf1e949ec224eda (9ms) I0330 15:01:21.879214 1 gather_workloads_info.go:387] No image sha256:72ae38682f25786aec18625cfed5d7831017d2f0f1304c3320c00ce0b7fb09c1 (9ms) I0330 15:01:21.888460 1 gather_workloads_info.go:387] No image sha256:5f852f6127d27e6fc071afe58d80024370467cb2476f4d9f077f8ebca8600918 (9ms) I0330 15:01:21.898171 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (10ms) I0330 15:01:21.907452 1 gather_workloads_info.go:387] No image sha256:2f26472542da4f89a2ac34a93fd438d385419dda16811bdfa7e679e0115abe56 (9ms) I0330 15:01:21.919667 1 gather_workloads_info.go:387] No image sha256:3da5a449ace61cb7d002d8e7911c14905c74cf58a296527458d1af0f1abf0a72 (12ms) I0330 15:01:21.928938 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (9ms) I0330 15:01:21.938196 1 gather_workloads_info.go:387] No image sha256:1b58ba57c10e2ba03a0d8dba1f3f8faa866e1dca6170725b6909c2cc2b96efa6 (9ms) I0330 15:01:21.947116 1 gather_workloads_info.go:387] No image sha256:2ade6dfb5406ef3a4264dea95d455298f54e8ef4d458d9ee3e94c33d48676a9b (9ms) I0330 15:01:21.957391 1 gather_workloads_info.go:387] No image sha256:7e0a58aad44d5b09954f8261e3e428c8dfa076eb9c2b6ef46a91d27ac78ac17a (10ms) I0330 15:01:22.058982 1 gather_workloads_info.go:387] No image sha256:14e983ca10e1033822e1c4be0a1e4a40762951a5d6e4a77bf642891f291d32ae (102ms) I0330 15:01:22.158690 1 gather_workloads_info.go:387] No image sha256:44ceafe5147680d58a5c2d3720932b972e6bc9639faadc19aa6b360af154e1a3 (100ms) I0330 15:01:22.258823 1 gather_workloads_info.go:387] No image sha256:3b9f60077c475f2baad0dd51ffc9d469f3a9b54c474bb86a35f93cb9b8fdc734 (100ms) I0330 15:01:22.359304 1 gather_workloads_info.go:387] No image sha256:6ea0f19030ffc52a290e6eeb812ef2426c48a2f1083b1e415e0667998cbb7bf2 (100ms) I0330 15:01:22.458373 1 gather_workloads_info.go:387] No image sha256:66640a3f7bd65090345552611701a73e74bc44897b9d29e43b11f73b96598ac0 (99ms) I0330 15:01:22.558970 1 gather_workloads_info.go:387] No image sha256:2e3661304917ce7f3be49974faacc60c24cbe2833d7b50c8c205c2f3f2467950 (101ms) I0330 15:01:22.658599 1 gather_workloads_info.go:387] No image sha256:a6b085cdad58db8529d99c22ec1ec79fe09ab00ab1c92ee38b29e7875dc0533c (100ms) I0330 15:01:22.758672 1 gather_workloads_info.go:387] No image sha256:12448aad6e9050c2b2445035be818a490cef502d39b73dbd51cc0f5ea7d67d40 (100ms) I0330 15:01:22.859174 1 gather_workloads_info.go:387] No image sha256:c59765325e6f286c067e555850b0d81f2de5e5ee8625ed83cdc2cea96f3a7ddb (100ms) I0330 15:01:22.959071 1 gather_workloads_info.go:387] No image sha256:51e1b5dc9fccbee5b7df78d0e8bbe379f75529232c102c9ed5b1ae134c4b9b4c (100ms) I0330 15:01:23.060258 1 gather_workloads_info.go:387] No image sha256:3e8d51b4b12d970bf561f67d0fcd9c0966a6d49866e6466daa341ee43d95d6e2 (101ms) I0330 15:01:23.159736 1 gather_workloads_info.go:387] No image sha256:31e175b644c6627779ca6b9f48d9426760dd449788ad671dd0277cce8fb822e8 (99ms) I0330 15:01:23.259117 1 gather_workloads_info.go:387] No image sha256:20a3e59566dd25058fff22e18569067fe6a12d8ac5ac62fa6508e0cee44d7897 (99ms) I0330 15:01:23.358811 1 gather_workloads_info.go:387] No image sha256:4c39dc633bf3560c2397281b74faf9d00500b0738dec6c1aad2cc8ce326be6fc (100ms) I0330 15:01:23.459167 1 gather_workloads_info.go:398] Found image sha256:1c5b548d67e5c56e3297b2f8aa34428e544b5b5ac88bd8d0f465760375c501e6 (100ms) I0330 15:01:23.559187 1 gather_workloads_info.go:387] No image sha256:12aec97ddeb527881acf5949bea2b227baa1dbfccf30679e8d57ff0b82e42707 (100ms) I0330 15:01:23.658752 1 gather_workloads_info.go:398] Found image sha256:70dcc3c7d3a572ecacc7c838fd17d07ff21531e50a7ed9227a17c27437151bf4 (100ms) I0330 15:01:23.758921 1 gather_workloads_info.go:387] No image sha256:0e5fa2595714628c16cf590efd28715bde790d2dc6b3a793b2a38dfb3ffb591a (100ms) I0330 15:01:23.860456 1 gather_workloads_info.go:387] No image sha256:64dbe77583c8b23dc6852fc482ea5b4081490734944ec8b765d5450b3fdb30ed (102ms) I0330 15:01:23.958784 1 gather_workloads_info.go:387] No image sha256:1ad039a130515504a258952cb18e67c3329da5182bb0623cc0891e6c15e2113a (98ms) I0330 15:01:24.058232 1 gather_workloads_info.go:387] No image sha256:8f72efd51f564d8d3e4ecee6555d7bd5394d0776054d2112febea6b7c9e71225 (99ms) I0330 15:01:24.158900 1 gather_workloads_info.go:387] No image sha256:4e62a2dcb8214491388d4c17f89fe699eb53cdb8039dcba6ab052edc28da3fbd (101ms) I0330 15:01:24.263348 1 gather_workloads_info.go:387] No image sha256:cfcb0bd30c537e677ac6856c36c0c923b415f24d944c7aa1386489f511f6491d (104ms) I0330 15:01:24.358849 1 gather_workloads_info.go:387] No image sha256:07a6c0a310270b830b96fcb8fca9cd11e45569276335bb5334b18b388d6eed51 (95ms) I0330 15:01:24.458939 1 gather_workloads_info.go:387] No image sha256:5b51a4d9d3b7ecad110fb6eb00f71e9e9b854067d79b220df397a58d9fa50eb0 (100ms) I0330 15:01:24.558365 1 gather_workloads_info.go:387] No image sha256:185a95b130b6a27ad88fcf39803215b7bd998472b1e37225858435f4eb7c3c04 (99ms) I0330 15:01:24.659087 1 gather_workloads_info.go:387] No image sha256:2a07c1b2ef06bbfa3a491b84f7410e24de7cb487f49bbbb3bfd7cb3510c8429a (101ms) I0330 15:01:24.758200 1 gather_workloads_info.go:387] No image sha256:92a731e25801365be0ad0916bec5bf24b2035e443ad1414a1631d1e0473ddf77 (99ms) I0330 15:01:24.858578 1 gather_workloads_info.go:387] No image sha256:87de118dc29ca1b47d4768ec5ed4441bc1dada3fb2a78d53b1833249baa86dd4 (100ms) I0330 15:01:24.959587 1 gather_workloads_info.go:387] No image sha256:1e6d59867cbd750672bc9ccfb9c69c3d198174cd43dd6d71a0da358b4b766473 (101ms) I0330 15:01:25.059282 1 gather_workloads_info.go:387] No image sha256:6263faa8ef7759ec21f26df08314c5d64e52d967b49961cb9404c54532c03365 (100ms) I0330 15:01:25.158626 1 gather_workloads_info.go:387] No image sha256:ad0e262327997e8cdc4074a2373e67274d9b8a943aa274a2cd8ce98ffe1db4a0 (99ms) I0330 15:01:25.258571 1 gather_workloads_info.go:387] No image sha256:aa65d1c7fb8805b767fc4878faea280472f372010efadc66e5641a2e634a80c0 (100ms) I0330 15:01:25.359974 1 gather_workloads_info.go:387] No image sha256:e476b4dafff885727b0057259c9df67a68e196f8cd92c21db2e4efe84a5f7a25 (101ms) I0330 15:01:25.458822 1 gather_workloads_info.go:387] No image sha256:24929612f2f0f2d4cd3ac163c04bbf4ac64cc47d3d0eef81db085d00c59058bd (99ms) I0330 15:01:25.558699 1 gather_workloads_info.go:387] No image sha256:5bd409efe77c6a126418be2c098dde9431c1a290cec885a7e37c0c8ddc2337a8 (100ms) I0330 15:01:25.658849 1 gather_workloads_info.go:387] No image sha256:3739c0c55f7f7ccc84309ae11eb23d3d9e5ad50a68e849a8a8dfda7f2f2bc137 (100ms) I0330 15:01:25.658887 1 tasks_processing.go:74] worker 1 stopped. I0330 15:01:25.659239 1 recorder.go:75] Recording config/workload_info with fingerprint=68422b161d37b1228798db8fd5996335bd09edc4569dd856ab37331a4ef86372 I0330 15:01:25.659261 1 gather.go:177] gatherer "workloads" function "workload_info" took 8.336686214s to process 1 records I0330 15:01:25.659275 1 periodic.go:263] Periodic gather workloads completed in 8.337s I0330 15:01:25.659286 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0330 15:01:25.659291 1 periodic.go:216] Running conditional gatherer I0330 15:01:25.664516 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.6/gathering_rules I0330 15:01:25.801214 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0330 15:01:25.803746 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.230.236:9091: connect: connection refused I0330 15:01:25.803821 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0330 15:01:25.809386 1 conditional_gatherer.go:392] cluster version is '4.21.6' E0330 15:01:25.809400 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809404 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809408 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809411 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809414 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809417 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809419 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809422 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809425 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0330 15:01:25.809428 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0330 15:01:25.809442 1 tasks_processing.go:45] number of workers: 3 I0330 15:01:25.809455 1 tasks_processing.go:69] worker 2 listening for tasks. I0330 15:01:25.809463 1 tasks_processing.go:69] worker 0 listening for tasks. I0330 15:01:25.809472 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0330 15:01:25.809481 1 tasks_processing.go:69] worker 1 listening for tasks. I0330 15:01:25.809492 1 tasks_processing.go:74] worker 1 stopped. I0330 15:01:25.809498 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0330 15:01:25.809498 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0330 15:01:25.809545 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0330 15:01:25.809557 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.115µs to process 1 records I0330 15:01:25.809589 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0330 15:01:25.809595 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.601µs to process 1 records I0330 15:01:25.809601 1 tasks_processing.go:74] worker 2 stopped. I0330 15:01:25.809748 1 tasks_processing.go:74] worker 0 stopped. I0330 15:01:25.809760 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 245.058µs to process 0 records I0330 15:01:25.809775 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0330 15:01:25.809793 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0330 15:01:25.835435 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=2c229013aab6574c0edebeb3e6b54abd76b4b914d638119ecc945ecf17d211b0 I0330 15:01:25.835570 1 diskrecorder.go:70] Writing 120 records to /var/lib/insights-operator/insights-2026-03-30-150125.tar.gz I0330 15:01:25.843124 1 diskrecorder.go:51] Wrote 120 records to disk in 7ms I0330 15:01:25.843153 1 periodic.go:285] Gathering cluster info every 2h0m0s I0330 15:01:25.843169 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0330 15:02:33.712412 1 diskrecorder.go:223] Found files to send: insights-2026-03-30-150125.tar.gz I0330 15:02:33.712443 1 insightsuploader.go:150] Checking archives to upload periodically every 15m51.378796714s I0330 15:02:33.712451 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0330 15:02:33.721591 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0330 15:02:33.884738 1 requests.go:87] Successfully reported id=2026-03-30T15:02:33Z x-rh-insights-request-id=895101ac7f1145eaac318a06185529d1, wrote=58022 I0330 15:02:33.884795 1 insightsuploader.go:187] Uploaded report successfully in 172.337903ms I0330 15:02:33.884816 1 controller.go:129] Initializing last reported time to 2026-03-30T15:02:33Z I0330 15:02:33.884831 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0330 15:02:33.884839 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0330 15:02:33.884846 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0330 15:02:33.890591 1 controller.go:554] The operator is healthy I0330 15:03:03.726681 1 controller.go:554] The operator is healthy I0330 15:03:34.594539 1 insightsreport.go:137] Pulling report from smart-proxy I0330 15:03:34.594570 1 insightsreport.go:149] Retrieving report I0330 15:03:34.603385 1 requests.go:110] Retrieving report for cluster: e8eb7593-a2e1-4582-97ca-eed5bdf52a32 I0330 15:03:34.603399 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/e8eb7593-a2e1-4582-97ca-eed5bdf52a32/reports I0330 15:03:34.606587 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/e8eb7593-a2e1-4582-97ca-eed5bdf52a32/reports I0330 15:03:34.804791 1 insightsreport.go:184] Report retrieved I0330 15:03:34.829883 1 insightsreport.go:239] Report retrieved correctly I0330 15:05:03.727430 1 controller.go:554] The operator is healthy I0330 15:06:03.701105 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0330 15:06:03.706151 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0330 15:06:03.706168 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0330 15:06:03.709689 1 secretconfigobserver.go:119] support secret does not exist I0330 15:07:03.745465 1 controller.go:554] The operator is healthy I0330 15:09:03.725002 1 controller.go:554] The operator is healthy I0330 15:11:03.698623 1 configmapobserver.go:84] configmaps "insights-config" not found I0330 15:11:03.702822 1 configmapobserver.go:84] configmaps "insights-config" not found I0330 15:11:03.709938 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0330 15:11:03.713811 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0330 15:11:03.713826 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0330 15:11:03.717389 1 secretconfigobserver.go:119] support secret does not exist I0330 15:11:03.723713 1 controller.go:554] The operator is healthy I0330 15:13:03.724829 1 controller.go:554] The operator is healthy