W0405 10:57:37.892071 1 cmd.go:257] Using insecure, self-signed certificates I0405 10:57:39.457948 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0405 10:57:39.458297 1 observer_polling.go:159] Starting file observer I0405 10:57:39.945212 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0405 10:57:39.945419 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0405 10:57:39.946054 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0405 10:57:39.946082 1 secure_serving.go:57] Forcing use of http/1.1 only W0405 10:57:39.946101 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0405 10:57:39.946105 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0405 10:57:39.946109 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0405 10:57:39.946113 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0405 10:57:39.946116 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0405 10:57:39.946119 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0405 10:57:39.953261 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0405 10:57:39.953277 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"2d4edf71-5038-40e3-a6c5-2bd9b6dd797e", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0405 10:57:39.955754 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0405 10:57:39.955775 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0405 10:57:39.955709 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0405 10:57:39.955811 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0405 10:57:39.955836 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0405 10:57:39.955856 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0405 10:57:39.956073 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2908019366/tls.crt::/tmp/serving-cert-2908019366/tls.key" I0405 10:57:39.956466 1 secure_serving.go:213] Serving securely on [::]:8443 I0405 10:57:39.956508 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0405 10:57:39.965040 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0405 10:57:39.965072 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0405 10:57:39.965159 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0405 10:57:39.970449 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 10:57:39.970466 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0405 10:57:39.977060 1 secretconfigobserver.go:119] support secret does not exist I0405 10:57:39.982645 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 10:57:39.987226 1 secretconfigobserver.go:119] support secret does not exist I0405 10:57:39.992274 1 recorder.go:176] Pruning old reports every 5h34m41s, max age is 288h0m0s I0405 10:57:39.997773 1 periodic.go:216] Running clusterconfig gatherer I0405 10:57:39.997791 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0405 10:57:39.997818 1 insightsreport.go:296] Starting report retriever I0405 10:57:39.997825 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0405 10:57:39.997842 1 tasks_processing.go:45] number of workers: 64 I0405 10:57:39.997890 1 tasks_processing.go:69] worker 21 listening for tasks. I0405 10:57:39.997899 1 tasks_processing.go:69] worker 43 listening for tasks. I0405 10:57:39.997903 1 tasks_processing.go:71] worker 21 working on authentication task. I0405 10:57:39.997907 1 tasks_processing.go:69] worker 44 listening for tasks. I0405 10:57:39.997907 1 tasks_processing.go:69] worker 42 listening for tasks. I0405 10:57:39.997914 1 tasks_processing.go:69] worker 45 listening for tasks. I0405 10:57:39.997918 1 tasks_processing.go:69] worker 46 listening for tasks. I0405 10:57:39.997919 1 tasks_processing.go:69] worker 32 listening for tasks. I0405 10:57:39.997926 1 tasks_processing.go:69] worker 47 listening for tasks. I0405 10:57:39.997926 1 tasks_processing.go:69] worker 33 listening for tasks. I0405 10:57:39.997929 1 tasks_processing.go:69] worker 31 listening for tasks. I0405 10:57:39.997933 1 tasks_processing.go:69] worker 34 listening for tasks. I0405 10:57:39.997936 1 tasks_processing.go:69] worker 48 listening for tasks. I0405 10:57:39.997941 1 tasks_processing.go:69] worker 29 listening for tasks. I0405 10:57:39.997941 1 tasks_processing.go:69] worker 35 listening for tasks. I0405 10:57:39.997946 1 tasks_processing.go:69] worker 49 listening for tasks. I0405 10:57:39.997948 1 tasks_processing.go:69] worker 36 listening for tasks. I0405 10:57:39.997947 1 tasks_processing.go:69] worker 26 listening for tasks. I0405 10:57:39.997956 1 tasks_processing.go:69] worker 30 listening for tasks. I0405 10:57:39.997960 1 tasks_processing.go:69] worker 37 listening for tasks. I0405 10:57:39.997951 1 tasks_processing.go:69] worker 50 listening for tasks. I0405 10:57:39.997955 1 tasks_processing.go:69] worker 51 listening for tasks. I0405 10:57:39.997966 1 tasks_processing.go:69] worker 22 listening for tasks. I0405 10:57:39.997952 1 tasks_processing.go:69] worker 28 listening for tasks. I0405 10:57:39.997961 1 tasks_processing.go:69] worker 52 listening for tasks. I0405 10:57:39.997974 1 tasks_processing.go:69] worker 27 listening for tasks. I0405 10:57:39.997775 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0405 10:57:39.997981 1 tasks_processing.go:69] worker 14 listening for tasks. I0405 10:57:39.997983 1 tasks_processing.go:69] worker 40 listening for tasks. I0405 10:57:39.997988 1 tasks_processing.go:69] worker 11 listening for tasks. I0405 10:57:39.997990 1 tasks_processing.go:69] worker 41 listening for tasks. I0405 10:57:39.997974 1 tasks_processing.go:69] worker 54 listening for tasks. I0405 10:57:39.997974 1 tasks_processing.go:69] worker 16 listening for tasks. I0405 10:57:39.997997 1 tasks_processing.go:69] worker 15 listening for tasks. I0405 10:57:39.997999 1 tasks_processing.go:69] worker 12 listening for tasks. I0405 10:57:39.998000 1 tasks_processing.go:69] worker 25 listening for tasks. I0405 10:57:39.998004 1 tasks_processing.go:69] worker 19 listening for tasks. I0405 10:57:39.997975 1 tasks_processing.go:69] worker 39 listening for tasks. I0405 10:57:39.998006 1 tasks_processing.go:69] worker 5 listening for tasks. I0405 10:57:39.998009 1 tasks_processing.go:69] worker 17 listening for tasks. I0405 10:57:39.998001 1 tasks_processing.go:69] worker 13 listening for tasks. I0405 10:57:39.998015 1 tasks_processing.go:69] worker 62 listening for tasks. I0405 10:57:39.998018 1 tasks_processing.go:69] worker 0 listening for tasks. I0405 10:57:39.998021 1 tasks_processing.go:69] worker 2 listening for tasks. I0405 10:57:39.998023 1 tasks_processing.go:69] worker 8 listening for tasks. I0405 10:57:39.998017 1 tasks_processing.go:69] worker 4 listening for tasks. I0405 10:57:39.998029 1 tasks_processing.go:69] worker 3 listening for tasks. I0405 10:57:39.998032 1 tasks_processing.go:71] worker 43 working on certificate_signing_requests task. I0405 10:57:39.998032 1 tasks_processing.go:71] worker 44 working on operators task. I0405 10:57:39.998039 1 tasks_processing.go:71] worker 31 working on openstack_version task. I0405 10:57:39.998044 1 tasks_processing.go:71] worker 29 working on sap_pods task. I0405 10:57:39.998046 1 tasks_processing.go:71] worker 3 working on qemu_kubevirt_launcher_logs task. I0405 10:57:39.997893 1 tasks_processing.go:69] worker 63 listening for tasks. I0405 10:57:39.998110 1 tasks_processing.go:71] worker 63 working on silenced_alerts task. I0405 10:57:39.997975 1 tasks_processing.go:69] worker 10 listening for tasks. I0405 10:57:39.997967 1 tasks_processing.go:69] worker 53 listening for tasks. I0405 10:57:39.998123 1 tasks_processing.go:71] worker 45 working on openstack_dataplanedeployments task. I0405 10:57:39.998358 1 tasks_processing.go:71] worker 42 working on image_registries task. I0405 10:57:39.998415 1 tasks_processing.go:69] worker 20 listening for tasks. I0405 10:57:39.997980 1 tasks_processing.go:69] worker 55 listening for tasks. I0405 10:57:39.997982 1 tasks_processing.go:69] worker 23 listening for tasks. I0405 10:57:39.997985 1 tasks_processing.go:69] worker 56 listening for tasks. I0405 10:57:39.997990 1 tasks_processing.go:69] worker 57 listening for tasks. I0405 10:57:39.997989 1 tasks_processing.go:69] worker 24 listening for tasks. I0405 10:57:39.997992 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0405 10:57:39.997968 1 tasks_processing.go:69] worker 38 listening for tasks. I0405 10:57:39.998000 1 tasks_processing.go:69] worker 58 listening for tasks. I0405 10:57:39.998007 1 tasks_processing.go:69] worker 60 listening for tasks. I0405 10:57:39.998008 1 tasks_processing.go:69] worker 61 listening for tasks. I0405 10:57:39.998012 1 tasks_processing.go:69] worker 18 listening for tasks. I0405 10:57:39.998013 1 tasks_processing.go:69] worker 59 listening for tasks. I0405 10:57:39.998019 1 tasks_processing.go:69] worker 6 listening for tasks. I0405 10:57:39.998024 1 tasks_processing.go:69] worker 9 listening for tasks. I0405 10:57:39.998138 1 tasks_processing.go:71] worker 41 working on olm_operators task. I0405 10:57:39.998539 1 tasks_processing.go:71] worker 9 working on version task. I0405 10:57:39.998189 1 tasks_processing.go:71] worker 27 working on support_secret task. I0405 10:57:39.998705 1 tasks_processing.go:71] worker 38 working on config_maps task. I0405 10:57:39.998718 1 tasks_processing.go:71] worker 61 working on overlapping_namespace_uids task. I0405 10:57:39.998486 1 tasks_processing.go:71] worker 53 working on dvo_metrics task. I0405 10:57:39.998971 1 tasks_processing.go:71] worker 58 working on feature_gates task. I0405 10:57:39.999010 1 tasks_processing.go:71] worker 59 working on node_features task. I0405 10:57:39.999066 1 tasks_processing.go:71] worker 20 working on monitoring_persistent_volumes task. I0405 10:57:39.999112 1 tasks_processing.go:71] worker 55 working on lokistack task. I0405 10:57:39.999293 1 tasks_processing.go:71] worker 57 working on pdbs task. I0405 10:57:39.999320 1 tasks_processing.go:71] worker 24 working on clusterroles task. I0405 10:57:39.999025 1 tasks_processing.go:71] worker 32 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0405 10:57:39.999358 1 tasks_processing.go:71] worker 56 working on nodenetworkconfigurationpolicies task. W0405 10:57:39.998143 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0405 10:57:39.998150 1 tasks_processing.go:71] worker 49 working on machines task. I0405 10:57:39.998153 1 tasks_processing.go:71] worker 36 working on crds task. I0405 10:57:39.998157 1 tasks_processing.go:71] worker 26 working on operators_pods_and_events task. I0405 10:57:39.998154 1 tasks_processing.go:71] worker 10 working on storage_classes task. I0405 10:57:39.998160 1 tasks_processing.go:71] worker 30 working on image task. I0405 10:57:39.998142 1 tasks_processing.go:71] worker 35 working on service_accounts task. I0405 10:57:39.998167 1 tasks_processing.go:71] worker 37 working on machine_healthchecks task. I0405 10:57:39.998171 1 tasks_processing.go:71] worker 50 working on openshift_logging task. I0405 10:57:39.998174 1 tasks_processing.go:71] worker 51 working on tsdb_status task. I0405 10:57:39.999476 1 tasks_processing.go:69] worker 7 listening for tasks. I0405 10:57:39.998172 1 tasks_processing.go:71] worker 47 working on openstack_controlplanes task. I0405 10:57:39.999491 1 tasks_processing.go:71] worker 7 working on ceph_cluster task. I0405 10:57:39.998177 1 tasks_processing.go:71] worker 22 working on nodes task. I0405 10:57:39.998180 1 tasks_processing.go:71] worker 5 working on openstack_dataplanenodesets task. I0405 10:57:39.998165 1 tasks_processing.go:71] worker 46 working on machine_sets task. I0405 10:57:39.998184 1 tasks_processing.go:71] worker 54 working on networks task. I0405 10:57:39.998186 1 tasks_processing.go:71] worker 52 working on node_logs task. I0405 10:57:39.998188 1 tasks_processing.go:71] worker 16 working on nodenetworkstates task. I0405 10:57:39.998194 1 tasks_processing.go:71] worker 15 working on ingress_certificates task. I0405 10:57:40.000718 1 tasks_processing.go:69] worker 1 listening for tasks. I0405 10:57:40.000734 1 tasks_processing.go:71] worker 1 working on image_pruners task. I0405 10:57:39.998194 1 tasks_processing.go:71] worker 34 working on pod_network_connectivity_checks task. I0405 10:57:39.998194 1 tasks_processing.go:71] worker 33 working on machine_autoscalers task. I0405 10:57:39.998198 1 tasks_processing.go:71] worker 12 working on mutating_webhook_configurations task. I0405 10:57:39.998201 1 tasks_processing.go:71] worker 25 working on sap_datahubs task. I0405 10:57:39.998200 1 tasks_processing.go:71] worker 48 working on container_images task. I0405 10:57:39.998204 1 tasks_processing.go:71] worker 0 working on storage_cluster task. I0405 10:57:39.998205 1 tasks_processing.go:71] worker 19 working on machine_configs task. I0405 10:57:39.998209 1 tasks_processing.go:71] worker 17 working on ingress task. I0405 10:57:39.998211 1 tasks_processing.go:71] worker 40 working on install_plans task. I0405 10:57:39.998211 1 tasks_processing.go:71] worker 39 working on oauths task. I0405 10:57:39.998213 1 tasks_processing.go:71] worker 13 working on validating_webhook_configurations task. I0405 10:57:39.998216 1 tasks_processing.go:71] worker 14 working on jaegers task. I0405 10:57:39.998218 1 tasks_processing.go:71] worker 8 working on sap_config task. I0405 10:57:39.998217 1 tasks_processing.go:71] worker 62 working on openshift_machine_api_events task. I0405 10:57:39.998221 1 tasks_processing.go:71] worker 4 working on aggregated_monitoring_cr_names task. I0405 10:57:39.998223 1 tasks_processing.go:71] worker 2 working on cluster_apiserver task. I0405 10:57:39.998223 1 tasks_processing.go:71] worker 11 working on machine_config_pools task. I0405 10:57:39.999044 1 tasks_processing.go:71] worker 60 working on infrastructures task. I0405 10:57:39.999051 1 tasks_processing.go:71] worker 18 working on active_alerts task. I0405 10:57:39.999062 1 tasks_processing.go:71] worker 23 working on metrics task. I0405 10:57:39.998183 1 tasks_processing.go:71] worker 28 working on container_runtime_configs task. I0405 10:57:40.001410 1 tasks_processing.go:71] worker 63 working on proxies task. W0405 10:57:39.999488 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0405 10:57:40.002894 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.265081ms to process 0 records I0405 10:57:40.002916 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 3.375363ms to process 0 records I0405 10:57:40.002926 1 tasks_processing.go:71] worker 51 working on schedulers task. I0405 10:57:40.003162 1 tasks_processing.go:71] worker 6 working on cost_management_metrics_configs task. W0405 10:57:40.003421 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0405 10:57:40.003429 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0405 10:57:40.003436 1 tasks_processing.go:74] worker 18 stopped. I0405 10:57:40.003444 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.877583ms to process 0 records I0405 10:57:40.003450 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.877326ms to process 0 records I0405 10:57:40.003455 1 tasks_processing.go:74] worker 23 stopped. I0405 10:57:40.004032 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0405 10:57:40.004048 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0405 10:57:40.004052 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0405 10:57:40.004055 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0405 10:57:40.004068 1 controller.go:531] The operator is still being initialized I0405 10:57:40.004073 1 controller.go:554] The operator is healthy I0405 10:57:40.007631 1 tasks_processing.go:74] worker 29 stopped. I0405 10:57:40.007645 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 9.572817ms to process 0 records I0405 10:57:40.010096 1 tasks_processing.go:74] worker 31 stopped. I0405 10:57:40.010103 1 gather_logs.go:145] no pods in namespace were found I0405 10:57:40.010132 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 12.049399ms to process 0 records I0405 10:57:40.010146 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 12.070882ms to process 0 records I0405 10:57:40.010155 1 tasks_processing.go:74] worker 3 stopped. I0405 10:57:40.010164 1 tasks_processing.go:74] worker 27 stopped. E0405 10:57:40.010179 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0405 10:57:40.010189 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 11.462493ms to process 0 records I0405 10:57:40.010197 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 8.785569ms to process 0 records I0405 10:57:40.010202 1 tasks_processing.go:74] worker 33 stopped. I0405 10:57:40.013538 1 tasks_processing.go:74] worker 58 stopped. I0405 10:57:40.013678 1 recorder.go:75] Recording config/featuregate with fingerprint=a79193600c9df82dfa9b320f895bfff09a4e2878592dacc30d697fe5f6959c87 I0405 10:57:40.013691 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 14.553346ms to process 1 records I0405 10:57:40.014776 1 tasks_processing.go:74] worker 14 stopped. I0405 10:57:40.014790 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 13.278478ms to process 0 records I0405 10:57:40.014816 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 13.270157ms to process 0 records I0405 10:57:40.014822 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 15.355359ms to process 0 records I0405 10:57:40.014827 1 tasks_processing.go:74] worker 50 stopped. I0405 10:57:40.014831 1 tasks_processing.go:74] worker 8 stopped. I0405 10:57:40.014997 1 tasks_processing.go:74] worker 55 stopped. I0405 10:57:40.015010 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 15.868489ms to process 0 records E0405 10:57:40.015078 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0405 10:57:40.015088 1 tasks_processing.go:74] worker 34 stopped. E0405 10:57:40.015095 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0405 10:57:40.015104 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 14.085588ms to process 0 records I0405 10:57:40.015112 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 15.509082ms to process 0 records I0405 10:57:40.015119 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 16.021747ms to process 0 records I0405 10:57:40.015123 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 15.738584ms to process 0 records I0405 10:57:40.015127 1 tasks_processing.go:74] worker 56 stopped. I0405 10:57:40.015128 1 tasks_processing.go:74] worker 46 stopped. I0405 10:57:40.015139 1 tasks_processing.go:74] worker 59 stopped. I0405 10:57:40.015143 1 tasks_processing.go:74] worker 21 stopped. I0405 10:57:40.015372 1 recorder.go:75] Recording config/authentication with fingerprint=dba4bf3ab7ef2472610555e21e64b30e3b570e9def96db54929df24c3a7f174b I0405 10:57:40.015396 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 17.233532ms to process 1 records I0405 10:57:40.015541 1 tasks_processing.go:74] worker 16 stopped. I0405 10:57:40.015550 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 15.201265ms to process 0 records E0405 10:57:40.015561 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0405 10:57:40.015569 1 gather.go:177] gatherer "clusterconfig" function "machines" took 16.150511ms to process 0 records I0405 10:57:40.015578 1 tasks_processing.go:74] worker 49 stopped. I0405 10:57:40.030565 1 tasks_processing.go:74] worker 39 stopped. I0405 10:57:40.030858 1 recorder.go:75] Recording config/oauth with fingerprint=8ca5625dbd9590e92d68e80ae0774c1c931583d9013278f4dd4b5daac47be991 I0405 10:57:40.030885 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 29.06542ms to process 1 records I0405 10:57:40.031371 1 tasks_processing.go:74] worker 37 stopped. E0405 10:57:40.031388 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0405 10:57:40.031398 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 31.900629ms to process 0 records I0405 10:57:40.033050 1 tasks_processing.go:74] worker 43 stopped. I0405 10:57:40.033064 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 35.002036ms to process 0 records I0405 10:57:40.036347 1 tasks_processing.go:74] worker 30 stopped. I0405 10:57:40.036419 1 recorder.go:75] Recording config/image with fingerprint=66a03c202fe42ceb31fef6172703f74a656a86e079aad91da15b5349e89d45b2 I0405 10:57:40.036431 1 gather.go:177] gatherer "clusterconfig" function "image" took 36.931904ms to process 1 records I0405 10:57:40.037149 1 tasks_processing.go:74] worker 42 stopped. I0405 10:57:40.037614 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=80659c3663f656e6ef874e32bbb6b47fb8d9edefc233c0da2655e6bcf87634f6 I0405 10:57:40.037632 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 38.769927ms to process 1 records I0405 10:57:40.051212 1 tasks_processing.go:74] worker 1 stopped. I0405 10:57:40.051423 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=41727ce5b55f0b098153e6d895da8ed178c368740d428430b3e353effca0c85b I0405 10:57:40.051465 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 50.467621ms to process 1 records I0405 10:57:40.053407 1 tasks_processing.go:74] worker 41 stopped. I0405 10:57:40.053420 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 54.922543ms to process 0 records I0405 10:57:40.054650 1 tasks_processing.go:74] worker 17 stopped. I0405 10:57:40.054818 1 recorder.go:75] Recording config/ingress with fingerprint=692699cdc16e0a4d5fabcf00db9a1958e4da8e5107b9cd5cb42ee88d57685890 I0405 10:57:40.054830 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 53.164707ms to process 1 records I0405 10:57:40.055997 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0405 10:57:40.056007 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0405 10:57:40.056054 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0405 10:57:40.057249 1 tasks_processing.go:74] worker 12 stopped. I0405 10:57:40.057399 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=98218fb50a5a777cf7aa2a5a3df1eb5be151578e007f6de29fb7379f155651f4 I0405 10:57:40.057429 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=de3fc085e223f13764fccb27858f8a6b8d795c9018f03a75bf25279e584c0d0a I0405 10:57:40.057457 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=45fac56533a29ef9036c04c981e0f07e5460d4e93bf6854fc426122ff64c295f I0405 10:57:40.057465 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 55.805165ms to process 3 records I0405 10:57:40.060823 1 tasks_processing.go:74] worker 25 stopped. I0405 10:57:40.060837 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 59.355762ms to process 0 records W0405 10:57:40.062520 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 10:57:40.065634 1 base_controller.go:82] Caches are synced for ConfigController I0405 10:57:40.065645 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0405 10:57:40.067790 1 tasks_processing.go:74] worker 45 stopped. I0405 10:57:40.067817 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 69.456327ms to process 0 records I0405 10:57:40.067824 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 68.323588ms to process 0 records I0405 10:57:40.067828 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 66.357562ms to process 0 records I0405 10:57:40.067833 1 tasks_processing.go:74] worker 0 stopped. I0405 10:57:40.067838 1 tasks_processing.go:74] worker 52 stopped. I0405 10:57:40.067839 1 tasks_processing.go:74] worker 7 stopped. I0405 10:57:40.067846 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 67.810973ms to process 0 records I0405 10:57:40.067852 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 68.345085ms to process 0 records I0405 10:57:40.067857 1 tasks_processing.go:74] worker 47 stopped. I0405 10:57:40.072317 1 tasks_processing.go:74] worker 57 stopped. I0405 10:57:40.072422 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=737475f3dab8c8e58e649aaee48331c362ba0ab51b2cbe632a62cca397b2d5d0 I0405 10:57:40.072455 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=1c63b5f105d949d891f75e308fd0d46fe2e5b5ed3cf06b3ce698aebb957590e5 I0405 10:57:40.072485 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=81a0353af0f510a30642f171c3ea43af80002fc40e99c09666b14cd40fac56eb I0405 10:57:40.072498 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 73.003928ms to process 3 records I0405 10:57:40.075465 1 tasks_processing.go:74] worker 61 stopped. I0405 10:57:40.075490 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0405 10:57:40.075498 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 76.730112ms to process 1 records I0405 10:57:40.077075 1 tasks_processing.go:74] worker 10 stopped. I0405 10:57:40.077168 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=a2d3f9319acac59a8b8f299e0cc5779f2f003596a21b50e6dfb9d1e9fa9f4aa6 I0405 10:57:40.077195 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=f6757ffe43a832698f4ce8ea5378b609bbed1feca4b7fe3eda4cf8f636cb1663 I0405 10:57:40.077203 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 77.659856ms to process 2 records I0405 10:57:40.077255 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=a9fa51467a8b6b907bc69579141152dd68b4a51e2da71d83117f484d552cbc30 I0405 10:57:40.077263 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 74.241915ms to process 1 records I0405 10:57:40.077269 1 tasks_processing.go:74] worker 51 stopped. I0405 10:57:40.077784 1 tasks_processing.go:74] worker 5 stopped. I0405 10:57:40.077815 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 78.239306ms to process 0 records I0405 10:57:40.077910 1 tasks_processing.go:74] worker 54 stopped. I0405 10:57:40.077948 1 recorder.go:75] Recording config/network with fingerprint=5550da9c74e2c094b64611c5bfd9d9953e781a223bb15707641a4676927b91e5 I0405 10:57:40.077964 1 gather.go:177] gatherer "clusterconfig" function "networks" took 78.16115ms to process 1 records I0405 10:57:40.078052 1 tasks_processing.go:74] worker 6 stopped. I0405 10:57:40.078060 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 74.861718ms to process 0 records I0405 10:57:40.078094 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 76.504036ms to process 0 records I0405 10:57:40.078101 1 tasks_processing.go:74] worker 11 stopped. I0405 10:57:40.079525 1 tasks_processing.go:74] worker 28 stopped. I0405 10:57:40.079538 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 77.956326ms to process 0 records I0405 10:57:40.081552 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 82.292461ms to process 0 records I0405 10:57:40.081913 1 tasks_processing.go:74] worker 20 stopped. I0405 10:57:40.086086 1 tasks_processing.go:74] worker 19 stopped. E0405 10:57:40.086098 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0405 10:57:40.086128 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0405 10:57:40.086138 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 84.60517ms to process 1 records I0405 10:57:40.091603 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 10:57:40.091701 1 tasks_processing.go:74] worker 24 stopped. I0405 10:57:40.091892 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=0c8434e21871761ed0d55292fb8d9a5652aa92c6087a51e57dd826840fd29f09 I0405 10:57:40.091996 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b8f77cbd341b37af30c06a55c402f2f38a88cb9fac54f8774aeb17632b0e7604 I0405 10:57:40.092010 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 92.365445ms to process 2 records I0405 10:57:40.092067 1 recorder.go:75] Recording config/proxy with fingerprint=02d3fdd8adc92a8129502e8ba7fd8167a869224198fa45820416a134b67ee8ab I0405 10:57:40.092078 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 90.141784ms to process 1 records I0405 10:57:40.092098 1 tasks_processing.go:74] worker 63 stopped. I0405 10:57:40.092173 1 tasks_processing.go:74] worker 2 stopped. I0405 10:57:40.092240 1 recorder.go:75] Recording config/apiserver with fingerprint=f836af4c93584ba3120398cde6668def05a0212b0ea4d15a671d889aa69feb03 I0405 10:57:40.092254 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 90.289386ms to process 1 records I0405 10:57:40.104130 1 tasks_processing.go:74] worker 60 stopped. I0405 10:57:40.104152 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0405 10:57:40.104231 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0405 10:57:40.104262 1 operator.go:328] started I0405 10:57:40.104277 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0405 10:57:40.104669 1 recorder.go:75] Recording config/infrastructure with fingerprint=877c680899df96c24cd04045c67a006891041cc8ddb1746c03bb5e4e1cc9303d I0405 10:57:40.104685 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 102.572655ms to process 1 records I0405 10:57:40.104695 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 102.854421ms to process 0 records I0405 10:57:40.104700 1 tasks_processing.go:74] worker 62 stopped. I0405 10:57:40.105833 1 tasks_processing.go:74] worker 32 stopped. I0405 10:57:40.105847 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 106.471387ms to process 0 records I0405 10:57:40.106503 1 tasks_processing.go:74] worker 36 stopped. I0405 10:57:40.107349 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=38d8eef835ee9ab609a7a62bae0c05b9840f58c5993e40764c974b6f2a03ee5a I0405 10:57:40.108447 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=def3648d3dcc2535978240d39c7391749a5c21bfcca56fcd137e597ce8af5dcf I0405 10:57:40.108465 1 gather.go:177] gatherer "clusterconfig" function "crds" took 106.972223ms to process 2 records I0405 10:57:40.108555 1 tasks_processing.go:74] worker 13 stopped. I0405 10:57:40.108565 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=d0e1991e394d67cd23da07d70fdb96eee370309be0cad7d89a4c5ad2f65997be I0405 10:57:40.108634 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=f00a7eb5e341267410e69c039265be9667042a8353c321275cafd3d0a9263261 I0405 10:57:40.108655 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=fda275542af04155eec5ea892c0a76404bc773254713d061742fa930911ebd27 I0405 10:57:40.108708 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=4bad3692e4c9d5a7b9bcf44e5bc034564c8feb60f8396b5858502d1a582fef47 I0405 10:57:40.108732 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=10ec718e839207155ff126c6c0a6dae749c9004cdb63f790e2127caaf61e22da I0405 10:57:40.108755 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=42dafd250205d09360951fb6bcea458dfd5b1fb1a33cffd850f5afb1e3074686 I0405 10:57:40.108778 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=611deff19c5cb8e5696eaafc5c07e1c842fb1786157de2d225769d2706d136cd I0405 10:57:40.108831 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=7b3f6b01b5ccba1473fb270874dd083c7573033b132b6ffbdc1841c1cf9f9c84 I0405 10:57:40.108856 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=4bbd3adc4f9f020011329909536c1cdf01d1d92c23540b3e2917df31efa8f7a2 I0405 10:57:40.108879 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=39fe74a56d4e110a7f5e682e1241e41a3e8b0eb29a48f92e1e1f41d9de874734 I0405 10:57:40.108901 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=63067595d1719afe2a2c9444f48e6d09512993dd23919c09b694ccaf8794b146 I0405 10:57:40.108909 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 105.490975ms to process 11 records I0405 10:57:40.111493 1 tasks_processing.go:74] worker 9 stopped. I0405 10:57:40.111699 1 recorder.go:75] Recording config/version with fingerprint=c063b3b6befd1b9adc953f50d59865b77784556d6791165ff4dc49177c9e9fe3 I0405 10:57:40.111715 1 recorder.go:75] Recording config/id with fingerprint=5d8426d1ea5719d8ba8be5c7288ca6246669622662a7333fd283b5da1a9376fc I0405 10:57:40.111721 1 gather.go:177] gatherer "clusterconfig" function "version" took 112.935711ms to process 2 records I0405 10:57:40.127715 1 tasks_processing.go:74] worker 48 stopped. I0405 10:57:40.130375 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0405 10:57:40.130392 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0405 10:57:40.130397 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0405 10:57:40.130402 1 controller.go:254] Source scaController *sca.Controller is not ready I0405 10:57:40.130405 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0405 10:57:40.130426 1 controller.go:531] The operator is still being initialized I0405 10:57:40.130433 1 controller.go:554] The operator is healthy I0405 10:57:40.130707 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-57d9b95648-xw6xq with fingerprint=d2c245e4a6f564072e3ba90436c9603884dd6b734892abcc547ae2ad6ad1256d I0405 10:57:40.130816 1 recorder.go:75] Recording config/running_containers with fingerprint=e62e5bc085c1f563f743cbf17d63d4f50e244d89e5a68d5b1079b7b22d2cfad9 I0405 10:57:40.130834 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 126.242168ms to process 2 records I0405 10:57:40.135693 1 tasks_processing.go:74] worker 4 stopped. I0405 10:57:40.135707 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 134.141414ms to process 0 records E0405 10:57:40.137208 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27f6293fa2-386d-4b5b-ae8d-091aea9bff3a%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:40611->172.30.0.10:53: read: connection refused I0405 10:57:40.137223 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27f6293fa2-386d-4b5b-ae8d-091aea9bff3a%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:40611->172.30.0.10:53: read: connection refused I0405 10:57:40.144015 1 prometheus_rules.go:88] Prometheus rules successfully created I0405 10:57:40.144763 1 tasks_processing.go:74] worker 22 stopped. I0405 10:57:40.145040 1 recorder.go:75] Recording config/node/ip-10-0-0-209.ec2.internal with fingerprint=fb5cf39428800410b4fc4026e347bff91ee2c4fdf61d504c14a3c08bf9fbd915 I0405 10:57:40.145097 1 recorder.go:75] Recording config/node/ip-10-0-1-205.ec2.internal with fingerprint=602d9f4946c4d94467063704d122e4a8b293b11856c973fb41d7ed0a5d35ebf5 I0405 10:57:40.145148 1 recorder.go:75] Recording config/node/ip-10-0-2-248.ec2.internal with fingerprint=a28b248519bf93f1cb091bd09a6b5234e4e5e6620ffb517444ce6da80de3fac3 I0405 10:57:40.145163 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 145.249909ms to process 3 records I0405 10:57:40.155511 1 tasks_processing.go:74] worker 38 stopped. E0405 10:57:40.155525 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0405 10:57:40.155537 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0405 10:57:40.155541 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0405 10:57:40.155551 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=20ed6d7fdef919e1dbf14043d15a28454160f2e604706803e55a38d1623c3158 I0405 10:57:40.155586 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0405 10:57:40.155594 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0405 10:57:40.155598 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=0bcb269fd90b6e8af4a57174ee20ae48ebee01bb0a0c651000e372609b4ee122 I0405 10:57:40.155602 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0405 10:57:40.155640 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0405 10:57:40.155649 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0405 10:57:40.155654 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 156.789329ms to process 7 records I0405 10:57:40.158341 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0405 10:57:40.162138 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:55587->172.30.0.10:53: read: connection refused I0405 10:57:40.162152 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:55587->172.30.0.10:53: read: connection refused I0405 10:57:40.204366 1 base_controller.go:82] Caches are synced for LoggingSyncer I0405 10:57:40.204385 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0405 10:57:40.224027 1 tasks_processing.go:74] worker 15 stopped. E0405 10:57:40.224047 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0405 10:57:40.224059 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pfutco3mvibijm2ul7f44g195rtsmmn-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pfutco3mvibijm2ul7f44g195rtsmmn-primary-cert-bundle-secret" not found I0405 10:57:40.224138 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=0ca8e336ebbc99cf37b5b7d01e2d7c77fdf3e4d78adb5cc55f00df92bb362284 I0405 10:57:40.224158 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 223.339139ms to process 1 records W0405 10:57:41.063259 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 10:57:41.261836 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0405 10:57:41.261855 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0405 10:57:41.262816 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-qsckf pod in namespace openshift-dns (previous: false). I0405 10:57:41.496565 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qsckf pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-qsckf\" is waiting to start: ContainerCreating" I0405 10:57:41.496586 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-qsckf\" is waiting to start: ContainerCreating" I0405 10:57:41.496595 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-qsckf pod in namespace openshift-dns (previous: false). I0405 10:57:41.515159 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0405 10:57:41.668236 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qsckf pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-qsckf\" is waiting to start: ContainerCreating" I0405 10:57:41.668253 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-qsckf\" is waiting to start: ContainerCreating" I0405 10:57:41.668264 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-w9tkn pod in namespace openshift-dns (previous: false). I0405 10:57:41.867691 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-w9tkn pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-w9tkn\" is waiting to start: ContainerCreating" I0405 10:57:41.867709 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-w9tkn\" is waiting to start: ContainerCreating" I0405 10:57:41.867717 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-w9tkn pod in namespace openshift-dns (previous: false). W0405 10:57:42.062601 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 10:57:42.065936 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-w9tkn pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-w9tkn\" is waiting to start: ContainerCreating" I0405 10:57:42.065950 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-w9tkn\" is waiting to start: ContainerCreating" I0405 10:57:42.065961 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-bg5p7 pod in namespace openshift-dns (previous: false). I0405 10:57:42.117303 1 tasks_processing.go:74] worker 44 stopped. I0405 10:57:42.117351 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=308abde444badad7605d63a9a354fd3df6ff8aee83bd4cfb1288d6786482c059 I0405 10:57:42.117393 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=097911122197f867ece282b2ab7b58f4ccd607935e0b7a9cad243d9d6dc42139 I0405 10:57:42.117423 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0405 10:57:42.117448 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=5236cb12e8cb18d9393a4e76036808756150ad18c8c21eece07e2e03bf93565c I0405 10:57:42.117465 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0405 10:57:42.117505 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=7cad8401b0de768f6fa90050dde9cad1040ad17a33af799c976d28ce71bc95f2 I0405 10:57:42.117536 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=b7d81f61f1076f345ab16157e41d0cef2986df17a0b646ed15e3f1d0f9cf8ded I0405 10:57:42.117560 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=f2b8432586247f8a48d16e94d0c6aaa16b435dec1199d4ebaa7e0dcb51147356 I0405 10:57:42.117574 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=15dec203f388db6a86e10da8cddef09f762b35a72c3b09d5ae8d17825680ce5a I0405 10:57:42.117591 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=2c99f189d8d05bc23b0f5883fe17548e130168bd74b1a6bd163a719b74f67388 I0405 10:57:42.117601 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0405 10:57:42.117618 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=0212bce6bcabe36bf397cf7d3b177291cd9c02bf9843aedc69b6a285f532556b I0405 10:57:42.117629 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0405 10:57:42.117644 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=d8f09aae2f9bd35ee74c44150ad7eef1ff24de426562952ff2eb4fdf5257f103 I0405 10:57:42.117653 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0405 10:57:42.117673 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=5c066196ec1a9a576253ecf77b17fa7cdc1526b7fa741688bac486706c1ec7a6 I0405 10:57:42.117682 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0405 10:57:42.117698 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=031537fdafb2676c44558503413a3b6a0b285b9a94610d791ece9def111dd7e1 I0405 10:57:42.117842 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=1e360c761fb380725a823c3a7e4d79a4388f5860ca71e2750afc5a307685f3e0 I0405 10:57:42.117854 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0405 10:57:42.117862 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0405 10:57:42.117882 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0405 10:57:42.117906 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=ba4cf4de6ef5cbb39eee7fb31666356d6c0d9252ad66813bfdc194a32f1f0154 I0405 10:57:42.117928 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=c4515f642f7fa48ff1c843ee42fa7b754ff030e83bf157c85982de7bc98df34a I0405 10:57:42.117937 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0405 10:57:42.117953 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=a5e639e7953532700c5b00cb4a2900c6dafcf6ed62bc07ff0d5fc3a0ffba90c0 I0405 10:57:42.117960 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0405 10:57:42.117974 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=2ff284e352da058bc46583c6122573f2ef1264a29dda0478b14ed8f9b4b1fbfd I0405 10:57:42.117987 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=a3eb8067935785c3a50507476b08c25bd6e0bb89b7a9d443b05243cc5067b68f I0405 10:57:42.117999 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=13fba9aff92403f548417d9b152fe8920192570b858ab06504588e6bf484481c I0405 10:57:42.118013 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=8887e3e65883e7a986b66f57639af24f3b5966487ae71f41a3dc28bfe601e7bf I0405 10:57:42.118034 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=e5ae5f9b2b04fa25446a165141b23379b136260783ea3517d7ae2ee48aa330ce I0405 10:57:42.118043 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0405 10:57:42.118072 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=5b49541858912aeacbc0cb0f2b83cb9620b6a2caaf3a4228ba936f17006ecf09 I0405 10:57:42.118088 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0405 10:57:42.118095 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0405 10:57:42.118102 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.119250238s to process 36 records I0405 10:57:42.266235 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0405 10:57:42.266250 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-nvlm8 pod in namespace openshift-dns (previous: false). I0405 10:57:42.497437 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-resolver-nvlm8 pod in namespace openshift-dns for failing operator dns-node-resolver (previous: false): "container \"dns-node-resolver\" in pod \"node-resolver-nvlm8\" is waiting to start: ContainerCreating" I0405 10:57:42.497453 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns-node-resolver\" in pod \"node-resolver-nvlm8\" is waiting to start: ContainerCreating" I0405 10:57:42.497464 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-z9zv2 pod in namespace openshift-dns (previous: false). I0405 10:57:42.666059 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0405 10:57:42.666077 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-55c987c97f-v757x pod in namespace openshift-image-registry (previous: false). I0405 10:57:42.863748 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0405 10:57:42.863767 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6c94f88d9b-45lp5 pod in namespace openshift-image-registry (previous: false). W0405 10:57:43.062787 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 10:57:43.069007 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6c94f88d9b-45lp5 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6c94f88d9b-45lp5\" is waiting to start: ContainerCreating" I0405 10:57:43.069021 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6c94f88d9b-45lp5\" is waiting to start: ContainerCreating" I0405 10:57:43.069033 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6c94f88d9b-fmzqc pod in namespace openshift-image-registry (previous: false). I0405 10:57:43.269149 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6c94f88d9b-fmzqc pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6c94f88d9b-fmzqc\" is waiting to start: ContainerCreating" I0405 10:57:43.269166 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6c94f88d9b-fmzqc\" is waiting to start: ContainerCreating" I0405 10:57:43.269176 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-9th8b pod in namespace openshift-image-registry (previous: false). I0405 10:57:43.468849 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-ca-9th8b pod in namespace openshift-image-registry for failing operator node-ca (previous: false): "container \"node-ca\" in pod \"node-ca-9th8b\" is waiting to start: ContainerCreating" I0405 10:57:43.468864 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"node-ca\" in pod \"node-ca-9th8b\" is waiting to start: ContainerCreating" I0405 10:57:43.468875 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-lz9l4 pod in namespace openshift-image-registry (previous: false). I0405 10:57:43.665188 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0405 10:57:43.665204 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-tb4xd pod in namespace openshift-image-registry (previous: false). I0405 10:57:43.866240 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0405 10:57:43.866257 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5d7c6d47dc-45zdl pod in namespace openshift-ingress (previous: false). I0405 10:57:44.056382 1 configmapobserver.go:84] configmaps "insights-config" not found W0405 10:57:44.062835 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 10:57:44.064786 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5d7c6d47dc-45zdl pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5d7c6d47dc-45zdl\" is waiting to start: ContainerCreating" I0405 10:57:44.064814 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5d7c6d47dc-45zdl\" is waiting to start: ContainerCreating" I0405 10:57:44.064825 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7764dc9d4-9jzpj pod in namespace openshift-ingress (previous: false). I0405 10:57:44.269852 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7764dc9d4-9jzpj pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7764dc9d4-9jzpj\" is waiting to start: ContainerCreating" I0405 10:57:44.269866 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7764dc9d4-9jzpj\" is waiting to start: ContainerCreating" I0405 10:57:44.269876 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7764dc9d4-gjvrg pod in namespace openshift-ingress (previous: false). I0405 10:57:44.464534 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7764dc9d4-gjvrg pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7764dc9d4-gjvrg\" is waiting to start: ContainerCreating" I0405 10:57:44.464550 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7764dc9d4-gjvrg\" is waiting to start: ContainerCreating" I0405 10:57:44.464562 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-frwrk pod in namespace openshift-ingress-canary (previous: false). I0405 10:57:44.664511 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-gt8nk pod in namespace openshift-ingress-canary (previous: false). I0405 10:57:44.869039 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-848b55fff-k6tct pod in namespace openshift-kube-storage-version-migrator (previous: false). W0405 10:57:45.059190 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0405 10:57:45.059214 1 tasks_processing.go:74] worker 53 stopped. E0405 10:57:45.059224 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0405 10:57:45.059236 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0405 10:57:45.059255 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0405 10:57:45.059272 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.060253528s to process 1 records I0405 10:57:45.067149 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-848b55fff-k6tct pod in namespace openshift-kube-storage-version-migrator (previous: false). I0405 10:57:45.265607 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-d4cbcbb94-bc9md pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0405 10:57:45.466857 1 tasks_processing.go:74] worker 26 stopped. I0405 10:57:45.466956 1 recorder.go:75] Recording events/openshift-dns with fingerprint=ac46e6293008d114c119319fd2453773d8d2a6da3cae72f92f7d224d1bb201f0 I0405 10:57:45.467038 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=991885a8e9e23a89ed86b1ba7289e46943f616611266f689e9695a5fbde8922e I0405 10:57:45.467067 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=cc8c2726eea254ada03623adce6e98c7e679ab5f5aec9df2cc7f53c4704e7d22 I0405 10:57:45.467114 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=c7035ea9cf32972a3d5947f9c39870d9b293805857a3da826b8a4c42b7d9177a I0405 10:57:45.467143 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=331ca13b582c9c21ba694ba1e30ca3a21288fb7fb637734132edc5a7e1930a1c I0405 10:57:45.467156 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=8654b80c5be9ab457ca4abe90a5b6469aef32d37ea121a256f6f37a7dced2b19 I0405 10:57:45.467203 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=de540cebfcea3dd5eb741b8ce80a422cce6716ac3a342c4911ec8164790030f8 I0405 10:57:45.467210 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-frwrk/serve-healthcheck-canary_current.log with fingerprint=8151e68e92343496c3ba14fcd02dca063ff6befd341217bff3ff408c2d22ee00 I0405 10:57:45.467214 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-gt8nk/serve-healthcheck-canary_current.log with fingerprint=7d9f199dbd1d9ba43d9e8fffd6f3311f8a292b4dbf95640040d4602cdac5c8d9 I0405 10:57:45.467226 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-848b55fff-k6tct/migrator_current.log with fingerprint=a6e87aaa301daad44ce37f5ec41159736e9c7d8336707930272145fe55929fc1 I0405 10:57:45.467232 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-848b55fff-k6tct/graceful-termination_current.log with fingerprint=c7b9c45cd56a4420b9220683cfc871c5fd0e861343cc24e8ac20f184b7b748b5 I0405 10:57:45.467291 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-d4cbcbb94-bc9md/kube-storage-version-migrator-operator_current.log with fingerprint=60383966f3a7114d2c42923289faea8c6c3896587bd08f343cad42b89653da90 I0405 10:57:45.467300 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 5.467444869s to process 12 records I0405 10:57:52.911525 1 tasks_processing.go:74] worker 40 stopped. I0405 10:57:52.911566 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0405 10:57:52.911579 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.910032629s to process 1 records I0405 10:57:53.407888 1 tasks_processing.go:74] worker 35 stopped. I0405 10:57:53.408165 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=7ddf795073bc5395a95429a28409923bc71b328da94f586bee093d6f578708e6 I0405 10:57:53.408182 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.408434439s to process 1 records E0405 10:57:53.408247 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.41s with: function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0405 10:57:53.409351 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0405 10:57:53.409365 1 periodic.go:216] Running workloads gatherer I0405 10:57:53.409378 1 tasks_processing.go:45] number of workers: 2 I0405 10:57:53.409384 1 tasks_processing.go:69] worker 1 listening for tasks. I0405 10:57:53.409388 1 tasks_processing.go:71] worker 1 working on workload_info task. I0405 10:57:53.409395 1 tasks_processing.go:69] worker 0 listening for tasks. I0405 10:57:53.409409 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0405 10:57:53.432421 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0405 10:57:53.435666 1 tasks_processing.go:74] worker 0 stopped. I0405 10:57:53.435681 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 26.244533ms to process 0 records I0405 10:57:53.440571 1 gather_workloads_info.go:387] No image sha256:8c9c050549f490f6b96eca68bb61a32f164b2152cae31b4ffb7d7ecc4bd678b1 (9ms) I0405 10:57:53.448239 1 gather_workloads_info.go:387] No image sha256:6552b42b5cec3ef82f4b7b30214f2b4e4561f83599f1a77341fe77b9a6171bc2 (8ms) I0405 10:57:53.455645 1 gather_workloads_info.go:387] No image sha256:524c4410d51b126c6097fae3b2ad88ec67900e7b786a9131b7a8e96a194e4847 (7ms) I0405 10:57:53.462937 1 gather_workloads_info.go:387] No image sha256:9ac7550a7edd59fdbc0e5b3d336defbd6fe0510087272b78d364a4580fd3d020 (7ms) I0405 10:57:53.470311 1 gather_workloads_info.go:387] No image sha256:1647489821e206e3ac1d3f1fbecdff3621ef87a7064f492906334c16f072a3e3 (7ms) I0405 10:57:53.478412 1 gather_workloads_info.go:387] No image sha256:62075f81a8bc4ce5a7192023a80f2e27c2bc4fae547193776513d67fbddad601 (8ms) I0405 10:57:53.485462 1 gather_workloads_info.go:387] No image sha256:543891894646911f3714c3ebb7dd08f28cb0f0ea0d51045d058f7d2e9d475481 (7ms) I0405 10:57:53.492979 1 gather_workloads_info.go:387] No image sha256:326a8b5302b495cb059364ab96dfdd38425252613cfa3abb7e1dacaecda4fb1e (8ms) I0405 10:57:53.501256 1 gather_workloads_info.go:387] No image sha256:11b1019f1ef459a09826a731547c78028048bf66d9d35d3fadf20efa387c176c (8ms) I0405 10:57:53.508348 1 gather_workloads_info.go:387] No image sha256:0644c26b6a8f4aa4435145653370dd3f8438c6e299523ff8570eb2858ac65d09 (7ms) I0405 10:57:53.539842 1 gather_workloads_info.go:387] No image sha256:d3f704ef5d26f879256ea0687dfb2374356e3279ea6fb1cafa7dee815cd5bf3c (31ms) I0405 10:57:53.640229 1 gather_workloads_info.go:387] No image sha256:b7dc3625a2da745c86603678c78be7dafd64ea85ecd62745be29f3d04ec4e340 (100ms) I0405 10:57:53.740692 1 gather_workloads_info.go:387] No image sha256:0b449cd4c58e81397bc99ba2d0970585d2a3cc1472a8134b46cf20e8c488b8c5 (100ms) I0405 10:57:53.839668 1 gather_workloads_info.go:387] No image sha256:9fed4b776332f3e8ce9c8454beabcb0c940b0e09c0c973eeafcf653b27a79043 (99ms) I0405 10:57:53.940397 1 gather_workloads_info.go:387] No image sha256:8d824fc165afff23fffc5b291acfa0c1a98f01a96f86ad547eadaa7c98efd35f (101ms) I0405 10:57:54.040502 1 gather_workloads_info.go:387] No image sha256:17eab4abb2d95e2fe5dead3b0ccd144401f0f4467fc5f1dec8e19d5cb9bfd315 (100ms) I0405 10:57:54.141230 1 gather_workloads_info.go:387] No image sha256:5589d0d744b2f935e7f1bb3e094e813685092910a00e1853891b31fe9e330d23 (101ms) I0405 10:57:54.240424 1 gather_workloads_info.go:387] No image sha256:5e61f9895dd3c359917209aaa56cb9a1fba5e7b7946348f44ff1301045f0d1f0 (99ms) I0405 10:57:54.341087 1 gather_workloads_info.go:387] No image sha256:7958abc201949f9faed6fe6cd4f8e2f8dab06dde35f09779cec19e9286f3983d (101ms) I0405 10:57:54.441354 1 gather_workloads_info.go:387] No image sha256:2f4b0241dc0818547ffbaf42f8f17cac3ea8cde598a6c0bd3896872f53f7a3ff (100ms) I0405 10:57:54.540077 1 gather_workloads_info.go:387] No image sha256:645ce33140c6bccfc5926a1d19a02f60d9b48c8d116dba2a300cdb43a0fd0220 (99ms) I0405 10:57:54.640769 1 gather_workloads_info.go:387] No image sha256:e56ae80d1ee80001d74e77cc8e562fe5d6ce211b44b3312343e2ed4ecfb8ab3f (101ms) I0405 10:57:54.740562 1 gather_workloads_info.go:387] No image sha256:07c82fce5e470c7ee9c3c1fdc6c953c962ed119411c88bf5fd4f0a08e3a0b9b7 (100ms) I0405 10:57:54.840253 1 gather_workloads_info.go:387] No image sha256:e251b56f79899ba2f5ece5dc68375ebba0157b35541861a0c8e31bc21d6adc52 (100ms) I0405 10:57:54.941037 1 gather_workloads_info.go:387] No image sha256:55cb1bfa110d67c2452259e6b4a2158b8f6e7c4bba9e7dfd661e0dea37ff2e25 (101ms) I0405 10:57:55.041339 1 gather_workloads_info.go:387] No image sha256:014e2427899021034589f5602bb55916492eba8531030bd8a07bf1501c99f374 (100ms) I0405 10:57:55.141232 1 gather_workloads_info.go:387] No image sha256:5ae6198359a92af6c4b317806ec8a33ff53d44189d14561a8f8a3153d7afdb81 (100ms) I0405 10:57:55.241553 1 gather_workloads_info.go:387] No image sha256:4def742b6a5ef27c09ac9540e132622ec7178284d8900b9a844cb425e8be0c94 (100ms) I0405 10:57:55.340270 1 gather_workloads_info.go:387] No image sha256:d848a704d00962d119017a322bba7e97421e75ece9a3ce79162e0627935d2e4c (99ms) I0405 10:57:55.443021 1 gather_workloads_info.go:387] No image sha256:3b313209f88d2df827ff378cf0af36bd18908f1cab0e7ace14df1e8ffa5f1c00 (103ms) I0405 10:57:55.541118 1 gather_workloads_info.go:387] No image sha256:215264f061f8b0eeba17dc442cf5a6a3a754f67104bf271f61d2ccee30b7e663 (98ms) I0405 10:57:55.640889 1 gather_workloads_info.go:387] No image sha256:595b03c50302148c33de51825571a2b59a1930591d461a717315be05c6efdbb1 (100ms) I0405 10:57:55.741005 1 gather_workloads_info.go:387] No image sha256:3d02603962035bdee1a13b1b0d17740cc9c5bcdc89f2372652e5a7dd907ca313 (100ms) I0405 10:57:55.840650 1 gather_workloads_info.go:387] No image sha256:1c6f9f9f726be814274f19e66bd04d069236460a312faa274eebe757d33f889c (100ms) I0405 10:57:55.941217 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (101ms) I0405 10:57:56.040490 1 gather_workloads_info.go:387] No image sha256:5fd3dcbd54108018a438b849eb89f35b4c34343cb5319fbfb30cf252e2a58a8f (99ms) I0405 10:57:56.141134 1 gather_workloads_info.go:387] No image sha256:e468e359bdc654b85aa2e26fe6d9ff065bc85650d57be4cfd6879d5666cd08cd (101ms) I0405 10:57:56.141165 1 tasks_processing.go:74] worker 1 stopped. E0405 10:57:56.141175 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0405 10:57:56.141437 1 recorder.go:75] Recording config/workload_info with fingerprint=752be7780f866e073c5fd62383ccb9cba7f849b8a00aa7aa2d4e6426d199cc47 I0405 10:57:56.141452 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.73177052s to process 1 records E0405 10:57:56.141476 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.732s with: function \"workload_info\" failed with an error" I0405 10:57:56.142583 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0405 10:57:56.142597 1 periodic.go:216] Running conditional gatherer I0405 10:57:56.148083 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.7/gathering_rules I0405 10:57:56.154481 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.7/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.10:37501->172.30.0.10:53: read: connection refused E0405 10:57:56.154824 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0405 10:57:56.154896 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0405 10:57:56.160327 1 conditional_gatherer.go:392] cluster version is '4.21.7' E0405 10:57:56.160340 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 10:57:56.160345 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 10:57:56.160348 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 10:57:56.160351 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 10:57:56.160354 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 10:57:56.160357 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 10:57:56.160359 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 10:57:56.160362 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 10:57:56.160365 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0405 10:57:56.160379 1 tasks_processing.go:45] number of workers: 3 I0405 10:57:56.160391 1 tasks_processing.go:69] worker 2 listening for tasks. I0405 10:57:56.160395 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0405 10:57:56.160408 1 tasks_processing.go:69] worker 0 listening for tasks. I0405 10:57:56.160415 1 tasks_processing.go:69] worker 1 listening for tasks. I0405 10:57:56.160423 1 tasks_processing.go:74] worker 1 stopped. I0405 10:57:56.160435 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0405 10:57:56.160437 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0405 10:57:56.160502 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0405 10:57:56.160519 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.014µs to process 1 records I0405 10:57:56.160568 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0405 10:57:56.160580 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.063µs to process 1 records I0405 10:57:56.160588 1 tasks_processing.go:74] worker 0 stopped. I0405 10:57:56.160724 1 tasks_processing.go:74] worker 2 stopped. I0405 10:57:56.160735 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 270.84µs to process 0 records I0405 10:57:56.160753 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.7/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.10:37501->172.30.0.10:53: read: connection refused I0405 10:57:56.160770 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0405 10:57:56.184523 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=19d74eff54b147560d1893918c8f716b8073772990a0530e3e8aa2c737a6d0b9 I0405 10:57:56.184671 1 diskrecorder.go:70] Writing 107 records to /var/lib/insights-operator/insights-2026-04-05-105756.tar.gz I0405 10:57:56.191124 1 diskrecorder.go:51] Wrote 107 records to disk in 6ms I0405 10:57:56.191158 1 periodic.go:285] Gathering cluster info every 2h0m0s I0405 10:57:56.191179 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0405 10:57:56.301922 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 10:57:56.503309 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 10:58:04.582942 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 10:58:49.459578 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="ab1fc5edb326e9f3f4035c2cfbe61ac0487ccd178ef61b2520c98eb347056fb6") W0405 10:58:49.459607 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0405 10:58:49.459654 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0405 10:58:49.459679 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0405 10:58:49.459687 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="252942018bf751325ef618dbfa1570d24be2897acf59f93810085cc55092b4ab") I0405 10:58:49.459713 1 base_controller.go:181] Shutting down LoggingSyncer ... I0405 10:58:49.459748 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0405 10:58:49.459761 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0405 10:58:49.459771 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0405 10:58:49.459781 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0405 10:58:49.459751 1 periodic.go:177] Shutting down